-- Logs begin at Mon 2022-08-08 01:28:00 UTC, end at Mon 2022-08-08 02:54:39 UTC. -- Aug 08 02:17:23.412564 dv-cinder-733062-33-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 02:17:23.421525 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 02:17:23.423278 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 02:17:23 2022] *** Aug 08 02:17:23.423278 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 02:17:23.423278 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 02:17:23.423278 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: nodename: dv-cinder-733062-33-iscsi Aug 08 02:17:23.423278 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: machine: x86_64 Aug 08 02:17:23.423278 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: clock source: unix Aug 08 02:17:23.423278 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: pcre jit disabled Aug 08 02:17:23.423278 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: detected number of CPU cores: 4 Aug 08 02:17:23.423278 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: current working directory: / Aug 08 02:17:23.423278 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: detected binary path: /usr/bin/uwsgi-core Aug 08 02:17:23.423889 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: your processes number limit is 47680 Aug 08 02:17:23.423889 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: your memory page size is 4096 bytes Aug 08 02:17:23.423889 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: detected max file descriptor number: 2048 Aug 08 02:17:23.423889 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: lock engine: pthread robust mutexes Aug 08 02:17:23.423889 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: thunder lock: enabled Aug 08 02:17:23.423889 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 02:17:23.423889 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 02:17:23.462761 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: Python main interpreter initialized at 0x55b7e48159c0 Aug 08 02:17:23.462761 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: python threads support enabled Aug 08 02:17:23.462761 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: your server socket listen backlog is limited to 100 connections Aug 08 02:17:23.462761 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: your mercy for graceful operations on workers is 90 seconds Aug 08 02:17:23.463099 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 02:17:23.463174 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: *** Operational MODE: preforking *** Aug 08 02:17:23.463435 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: *** uWSGI is running in multiple interpreter mode *** Aug 08 02:17:23.463435 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: spawned uWSGI master process (pid: 103169) Aug 08 02:17:23.463613 dv-cinder-733062-33-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 02:17:23.464179 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: spawned uWSGI worker 1 (pid: 103170, cores: 1) Aug 08 02:17:23.464511 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: spawned uWSGI worker 2 (pid: 103171, cores: 1) Aug 08 02:17:23.464684 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 02:17:24.116971 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 02:17:24.119172 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 02:17:25.197221 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:17:25.197221 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: from cryptography.utils import int_from_bytes Aug 08 02:17:25.197859 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:17:25.197859 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: from cryptography.utils import int_from_bytes Aug 08 02:17:25.204555 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:17:25.204555 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: from cryptography.utils import int_from_bytes Aug 08 02:17:25.204981 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:17:25.204981 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: from cryptography.utils import int_from_bytes Aug 08 02:17:27.669457 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:17:27.670011 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:17:27.670209 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:17:27.670581 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:17:27.670833 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:17:27.671235 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.671557 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.671874 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.672184 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.672501 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.672803 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.672892 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:17:27.673317 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:17:27.673415 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.673415 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.673569 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:17:27.673725 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.673915 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:17:27.674019 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.674172 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:17:27.674287 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.674580 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.674667 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-33-iscsi {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.674897 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.674990 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.675197 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.675283 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.675501 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.675587 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.675813 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.675906 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.676111 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.676196 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.676426 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.676517 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.676724 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.676817 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.677070 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.677219 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.677322 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.678575 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.678807 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.678807 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.679143 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-33-iscsi {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.679355 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.679512 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.679729 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.679922 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.680112 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.680267 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.680442 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.680654 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.680810 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.681020 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.681207 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.681397 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.681552 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.681776 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.681959 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.682115 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.682361 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-33-iscsi {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.682550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.682705 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.682881 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.683056 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.683232 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.683427 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.683577 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.683707 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.683874 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.684002 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.684155 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.684291 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.684414 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.684534 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.684943 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.685073 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.685201 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.685331 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.685467 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.685603 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.685804 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-33-iscsi {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.685939 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.686062 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.686182 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.686355 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.686486 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.686616 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.686745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.686745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.687457 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.687608 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.687739 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.687860 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.687988 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.688111 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.688240 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.688369 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.688492 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.688612 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.688748 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.688903 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.689049 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.689180 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.689303 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.689423 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.689544 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.689664 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.689664 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.689918 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.690040 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.690163 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.690307 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.690432 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.690560 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.690684 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.690804 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.690924 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.691044 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.691177 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.691299 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.691426 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.691548 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.691675 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.691802 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.691931 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.692053 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.692179 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.692308 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.692429 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.692549 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.692686 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.692811 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.692932 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.693060 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.693182 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.693317 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.693440 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.693561 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.693681 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.693802 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.693930 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.693930 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.694174 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.694174 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.694476 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.694615 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.694739 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.694867 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.694990 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.695110 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.695231 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.695352 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.695472 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.695604 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.695734 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.695937 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.696062 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.696189 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.696327 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.696451 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.696572 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.696701 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.696824 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.697005 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.697144 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.697327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.697463 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.697625 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.697752 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.697873 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.698003 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.698148 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.698329 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.698472 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.698650 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.698784 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.698990 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.699122 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.699251 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.699381 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.699573 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.699715 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.699883 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.700017 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.700190 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.700316 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.700487 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.700627 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.700788 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.700922 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.701088 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.701222 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.701387 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.701529 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.701653 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.701773 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.701940 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.702066 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.702292 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.702436 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.703167 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.703289 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.703410 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.703531 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.703714 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.703842 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.704016 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.704149 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.704316 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.704441 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.704615 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.704749 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.704916 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.705043 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.705223 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.705347 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.705522 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.705648 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.705823 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.705963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.706152 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.706311 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.706442 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.706564 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.706740 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.706875 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.707047 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.707173 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.707347 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.707473 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.707649 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.707775 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.707959 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.708093 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.708252 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.708380 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.708551 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.708677 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.708857 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.708983 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.709155 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.709287 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.709456 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.709589 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.709753 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.709881 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.710049 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.710177 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.710386 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.710519 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.710641 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.710762 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.710937 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.711072 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.711234 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.711360 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.711523 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.711662 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.711835 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.711974 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.712152 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.712279 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.712452 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.712586 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.712754 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.712880 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.713052 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.713179 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.713355 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.713496 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.713659 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.713784 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.713962 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.714088 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.714285 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.714428 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.714595 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.714722 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.714900 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.715026 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.715206 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.715334 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.715505 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.715638 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.715823 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.715953 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.716205 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.716341 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.716463 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.716583 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.716739 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.716873 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.717043 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.717176 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.717351 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.717478 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:17:27.717664 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.717798 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.717977 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.718103 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.718349 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.718479 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.718664 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.718803 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.718974 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.719102 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.719294 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.719421 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.719600 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.719736 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.719913 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.720047 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.720229 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.720434 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.720568 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.720697 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.720820 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.720941 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.721151 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.721279 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.721461 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.721596 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.721777 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.721910 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.722092 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.722226 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.722430 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.722567 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.722737 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.722871 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.723041 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.723169 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.723344 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.723472 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.723661 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.723796 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.723985 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.724111 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.724283 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.724409 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.724593 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.724721 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.724900 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.725027 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.725207 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.725334 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.725510 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.725638 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.725816 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.725943 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.726121 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.726291 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.726480 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.726606 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.726770 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.726911 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.727079 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.727210 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.727385 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.727519 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.727694 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.727830 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.728000 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.728126 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.728305 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.728439 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.728609 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.728745 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.728906 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.729040 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.729205 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.729332 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.729500 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.729636 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.729802 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.729929 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.730097 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.730223 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.730432 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.730568 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.730750 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.730877 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.731048 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.731183 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.731369 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.731497 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.731665 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.731800 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.731967 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.732096 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.732268 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.732396 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.732571 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.732705 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.732866 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.733021 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.733174 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.733307 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.733476 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.733604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.733800 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.733926 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.734106 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.734232 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.734434 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.734559 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.734735 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.734874 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.735052 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.735178 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.735348 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.735505 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.735647 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.735782 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.735953 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.736081 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.736258 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.736387 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.736569 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.736722 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.736873 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.737004 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.737176 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.737311 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.737484 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.737618 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.737790 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.737925 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.738096 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.738214 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.738446 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.738569 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.738739 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.738866 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.739065 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.739192 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.739373 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.739501 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.739677 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.739812 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.739993 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.740119 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.740308 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.740435 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.740623 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.740750 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.740935 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.741070 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.741232 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.741360 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.741529 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.741657 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.741833 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.741976 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.742130 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.742303 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.742455 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.742595 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.742754 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.742889 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.743051 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.743177 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.743347 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.743474 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.743659 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.743798 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.743961 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.744088 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.744259 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.744386 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.744556 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.744692 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.744852 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.744972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.745185 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.745313 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.745483 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.745623 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.745800 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.745942 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.746104 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.746230 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.746437 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.746565 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.746776 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.746903 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.747032 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.747160 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.747332 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.747467 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.747635 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.747761 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.747940 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.748067 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.748267 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.748397 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.748519 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.748639 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.748826 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.748963 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.749130 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.749256 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.749966 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.750101 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.750292 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.750440 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.750610 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.750737 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.750915 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.751050 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.751230 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.751365 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.751529 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.751663 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.751838 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.751973 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.752166 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.752307 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.752488 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.752616 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.752800 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.752926 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.753112 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.753238 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.753415 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.753540 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.753722 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.753850 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.754026 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.754155 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.754354 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.754482 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.754660 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.754787 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.754965 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.755093 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.755278 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.755405 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.755582 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.755709 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.755895 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.756022 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.756196 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.756330 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.756509 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.756642 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.756813 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.756929 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.757126 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.757237 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.757421 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.757529 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.757727 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.757824 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.758046 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.758145 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.758394 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.758542 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.758696 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.758822 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.759002 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.759137 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.759317 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.759453 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.759620 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.759747 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.759927 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.760060 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.760231 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.760366 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.760532 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.760667 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.760828 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.760954 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.761130 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.761258 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.761438 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.761571 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.761741 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.761868 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.762044 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.762173 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.762365 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.762497 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.762673 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.762800 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.762973 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.763109 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.763268 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.763395 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.763563 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.763697 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.763866 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.763993 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.764178 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.764305 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.764481 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.764623 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.764788 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.764914 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.765650 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.765779 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.765950 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.766086 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.766269 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.766399 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.766580 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.766708 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.766881 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.767098 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.767236 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.767368 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.767491 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.767612 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.767734 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.767869 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.768064 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.768192 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.768368 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.768496 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.768664 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.768793 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.768974 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.769108 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.769289 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.769422 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.769591 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.769719 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.769894 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.770020 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.770198 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.770331 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.770528 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.770627 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.770840 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.770937 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.771148 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.771243 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.771449 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.771545 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.771755 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.771859 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.772058 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.772155 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.772362 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.772460 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.772666 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.772763 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.772980 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.773089 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.773283 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.773379 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.773588 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.773684 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.773890 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.774003 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.774185 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.774294 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.774515 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.774611 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.774824 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.774925 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.775136 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.775379 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.775466 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.775707 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.775801 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.776019 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.776109 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.776331 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.776419 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.776638 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.776733 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.776950 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.777037 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.777259 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.777353 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.777570 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.777741 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.777881 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.777968 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.778183 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.778314 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.778513 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.778622 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.778815 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.778921 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.779113 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.779373 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.779460 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.779712 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.779808 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.780019 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.780106 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.780308 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.780397 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.780650 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.780746 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.780951 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.781039 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.781251 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.781338 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.781548 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.781637 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.781844 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.781932 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.782151 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.782266 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.782481 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.782571 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.782787 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.782888 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.783083 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.783170 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.783398 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.783711 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.783782 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.783847 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.783993 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.784089 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.784278 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.784380 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.784575 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.784670 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.784904 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.784989 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.785197 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.785350 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.785500 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.785587 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.785804 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.785891 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.786121 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.786223 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.786454 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.786546 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.786752 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.786838 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.787060 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.787154 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.787355 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.787450 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.787650 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.787739 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.787946 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.788035 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.788249 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.788345 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.788553 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.788640 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.788847 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.788942 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.789149 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.789237 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.789453 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.789540 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.789763 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.789852 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.790065 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.790149 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.790387 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.790497 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.790689 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.790780 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.790985 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.791073 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.791292 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.791398 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.791594 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.791682 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.791890 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.791977 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.792185 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.792281 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.792488 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.792577 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.792788 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.792877 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.793083 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.793171 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.793385 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.793472 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.793682 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.793776 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.793988 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.794078 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.794306 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.794409 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.794603 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.794693 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.794899 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.795034 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.795203 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.795290 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.795503 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.795597 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.795799 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.795887 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.796099 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.796184 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.796431 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.796531 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.796730 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.796817 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.797026 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.797120 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.797329 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.797428 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.797624 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.797720 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.797921 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.798016 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.798222 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.798361 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.798552 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.798639 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.798857 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.798945 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.799152 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.799248 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.799454 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.799541 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.799759 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.799846 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.800055 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.800149 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.800351 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.800442 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.800651 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.800747 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.800946 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.801043 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.801240 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.801328 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.801534 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.801625 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.801830 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.801918 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.802126 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.802225 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.802464 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.802553 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.802768 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.802857 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.803066 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.803153 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.803364 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.803461 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.803659 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.803746 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.803991 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.804079 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.804286 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.804382 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.804594 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.804680 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.804898 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.804984 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.805202 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.805303 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.805505 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.805592 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.805807 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.805892 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.806108 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.806202 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.806437 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.806526 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.806733 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.806821 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.807041 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.807138 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.807344 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.807469 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.807648 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.807742 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.807943 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.808032 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.808237 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.808331 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.808547 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.808635 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.808851 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.808989 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.809155 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.809243 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.809466 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.809811 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.810046 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.810135 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.810391 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.810495 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.810691 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.810780 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.810993 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.811081 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.811295 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.811381 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.811595 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.811691 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.812426 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.812520 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.812728 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.812971 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.813057 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.813289 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.813377 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.813613 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.813698 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.813916 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.814004 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.814219 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.814358 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.814540 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.814629 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.814842 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.814930 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.815143 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.815277 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.815438 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.815525 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.815750 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.815846 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.816050 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.816138 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.816346 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.816442 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.816648 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.816744 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.816945 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.817033 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.817250 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.817344 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.817545 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.817640 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.817860 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.817955 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.818175 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.818291 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.818515 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.818612 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.818822 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.818910 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.819136 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.819223 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.819438 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.819533 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.819741 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.819828 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.820045 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.820132 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.820346 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.820443 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.820652 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.820739 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.820963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.821049 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.821271 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.821359 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.821585 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.821672 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.821892 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.821979 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.822185 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.822345 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.822514 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.822662 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.822828 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.822975 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.823125 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.823283 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.823419 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.823595 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.823713 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.823906 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.824023 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.824224 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.824310 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.824538 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.824626 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.824841 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.825002 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.825254 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.825398 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.825567 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.825654 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.825878 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.825967 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.826190 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.826326 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.826527 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.826635 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.826831 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.826918 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.827143 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.827238 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.828022 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.828167 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.828307 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.828394 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.828612 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.828700 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.828916 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.829011 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.829230 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.829317 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.829532 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.829619 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.829836 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.829930 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.830144 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.830239 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.830480 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.830579 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.830794 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.830894 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.831106 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.831260 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.831414 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.831575 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.831729 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.831888 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.832128 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.832225 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.832440 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.832528 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.832745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.832833 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.833064 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.833167 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.833370 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.833459 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.833667 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.833755 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.833962 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.834058 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.834281 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.834374 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.834583 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.834671 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.834879 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.834976 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.835191 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.835278 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.835489 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.835613 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.835796 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.835891 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.836102 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.836197 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.836403 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.836499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.836699 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.836858 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.836995 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.837180 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.837305 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.837493 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.837602 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.837814 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.837902 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.838207 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.838336 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.838472 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.838562 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.838775 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.838881 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.839086 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.839182 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.839393 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.839480 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.839697 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.839784 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.839994 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.840096 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.840291 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.840380 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.840595 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.840682 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.840904 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.841069 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.841211 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.841305 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.841512 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.841598 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.841815 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.841910 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.842139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.842226 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.842464 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.842562 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.842784 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.842873 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.843120 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.843223 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.843430 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.843518 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.843740 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.843830 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.844044 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.844130 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.844344 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.844431 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.844640 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.844729 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.844966 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.845063 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.845237 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.845326 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.845533 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.845622 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.845827 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.845915 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.846128 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.846226 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.846450 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.846539 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.846746 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.846846 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.847042 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.847139 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.847357 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.847450 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.847655 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.847743 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.847966 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.848063 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.848315 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.848415 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.848562 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.848659 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.848860 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.848957 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.849155 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.849244 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.849488 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.849580 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.849782 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.849878 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.850100 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.850189 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.850432 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.850522 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.850749 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.850839 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.851058 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.851155 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.851363 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.851458 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.851668 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.851756 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.851974 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.852068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.852279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.852373 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.852589 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.852686 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.852898 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.852987 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.853200 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.853413 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.853518 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.853606 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.853802 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.853899 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.854109 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.854206 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.854481 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.854644 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.854791 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.854973 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.855124 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.855283 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.855439 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.855592 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.855767 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.855898 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.856090 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.856192 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.856410 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.856506 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.856731 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.856819 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.857050 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.857139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.857370 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.857459 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.857678 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.857765 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.857993 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.858098 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.858328 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.858438 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.858649 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.859233 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.859474 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.859563 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.859783 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.859870 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.860093 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.860304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.860393 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.860640 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.860728 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.860959 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.861049 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.861276 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.861365 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.861593 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.861688 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.861909 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.862005 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.862217 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.862340 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.862546 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.862644 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.862853 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.862954 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.863159 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.863256 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.863464 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.863552 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.863771 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.863867 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.864077 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.864166 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.864379 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.864468 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.864683 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.864783 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.864989 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.865078 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.865306 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.865395 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.865630 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.865770 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.865944 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.866032 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.866266 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.866368 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.866587 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.866676 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.866896 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.866984 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.867220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.867406 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.867539 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.867714 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.867857 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.868040 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.868173 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.868358 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.868490 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.868679 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.868797 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.868988 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.869090 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.869297 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.869398 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.869617 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.869720 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.869914 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.870080 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.870211 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.870350 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.870542 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.870631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.870843 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.870945 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.871138 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.871268 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.871453 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.871584 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.871754 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.871899 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.872050 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.872222 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.872361 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.872664 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.872751 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.873047 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.873186 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.873383 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.873520 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.873709 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.873829 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.874035 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.874131 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.874420 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.875086 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.875251 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.875404 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.875582 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.875708 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.875891 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.876025 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.876197 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.876327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.876509 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.876625 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.876820 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.876934 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.877126 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.877243 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.877450 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.877537 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.877764 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.877851 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.878072 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.878161 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.878418 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.878508 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.878720 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.878899 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.879024 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.879256 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.879345 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.879610 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.879716 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.879920 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.880033 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.880218 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.880315 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.880520 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.880609 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.880826 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.880923 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.881122 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.881212 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.881418 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.881506 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.881715 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.881805 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.882010 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.882107 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.882336 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.882428 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.882634 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.882733 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.882935 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.883024 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.883230 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.883318 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.883535 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.883633 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.883831 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.883919 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.884133 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.884221 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.884430 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.884520 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.884745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.884833 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.885042 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.885139 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.885380 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.885468 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.885688 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.885774 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.885991 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.886085 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.886327 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.886423 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.886631 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.886717 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.886934 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.887033 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.887241 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.887329 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.887545 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.887634 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.887857 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.888077 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.888167 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.888407 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.888496 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.888727 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.888891 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.889051 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.889138 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.889357 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.889444 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.889665 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.889823 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.890003 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.890096 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.890331 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.890424 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.890650 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.890751 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.890956 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.891044 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.891263 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.891351 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.891568 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.891669 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.891872 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.891960 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.892176 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.892264 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.892480 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.892570 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.892785 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.892873 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.893088 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.893178 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.893392 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.893681 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.893769 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.893982 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.894071 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.894306 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.894411 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.894622 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.894712 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.894917 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.895005 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.895225 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.895322 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.895556 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.895652 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.895869 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.895958 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.896180 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.896269 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.896488 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.896577 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.896800 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.896897 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.897101 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.897196 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.897403 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.897491 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.897707 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.897804 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.898008 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.898096 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.898338 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.898444 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.898657 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.898753 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.898964 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.899097 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.899265 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.899362 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.899572 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.899732 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.899884 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.899973 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.900194 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.900283 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.900505 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.900595 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.900821 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.900910 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.901158 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.901258 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.901472 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.901562 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.901778 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.901867 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.902093 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.902189 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.902422 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.902521 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.902735 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.902823 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.903046 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.903135 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.903357 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.903446 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.903667 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.903755 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.903964 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.904060 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.904259 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.904347 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.904556 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.904645 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.904855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.904952 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.905164 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.905292 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.905466 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.905644 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.905797 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.905968 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.906093 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.906316 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.906420 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.906632 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.906735 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.906954 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.907043 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.907267 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.907353 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.907562 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.907663 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.907863 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.907958 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.908156 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.908244 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.908450 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.908552 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.908743 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.908832 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.909036 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.909169 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.909331 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.909448 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.909625 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.909756 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.909925 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.910064 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.910221 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.910384 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.910556 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.910690 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.910850 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.911010 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.911156 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.911322 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.911411 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.911626 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.911714 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.911930 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.912030 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.912247 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.912335 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.912554 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.912641 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.912861 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.912958 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.913166 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.913254 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.913469 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.913561 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.913778 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.913868 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.914081 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.914170 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.914407 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.914499 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.914712 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.914801 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.915015 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.915109 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.915318 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.915406 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.915620 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.915708 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.915927 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.916022 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.916228 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.916328 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.916528 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.916616 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.916828 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.916915 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.917131 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.917228 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.917432 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.917519 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.917734 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.917821 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.918047 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.918145 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.918381 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.918485 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.918695 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.918792 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.919003 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.919144 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.919308 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.919407 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.919618 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.919707 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.919919 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.920016 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.920226 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.920321 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.920534 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.920622 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.920840 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.920930 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.921145 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.921744 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.921960 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.922049 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.922280 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.922371 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.922589 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.922679 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.922899 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.922997 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.923207 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.923296 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.923517 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.923604 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.923832 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.923928 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.924134 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.924223 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.924450 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.924537 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.924771 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.924867 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.925091 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.925180 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.925398 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.925492 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.925715 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.925803 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.926029 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.926118 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.926363 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.926455 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.926670 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.926761 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.926968 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.927056 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.927205 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:17:27.927294 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.927578 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.927894 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.928214 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.928527 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.928842 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.929161 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.929481 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.929807 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.930132 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.930472 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.930801 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.931127 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.931474 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.931789 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.932134 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.932464 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.932783 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.933096 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.933404 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:17:27.933650 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:17:28.079713 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Registered counter for database nova_api Aug 08 02:17:28.085985 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Registered counter for database nova_api Aug 08 02:17:28.100730 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:17:28.105494 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:17:28.107275 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:17:28.112569 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:17:28.162686 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.context [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c42a8d5-6ffe-4953-b1e2-c735d79966d9(cell1) {{(pid=103171) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 02:17:28.166518 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:17:28.166982 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:17:28.168443 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.context [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c42a8d5-6ffe-4953-b1e2-c735d79966d9(cell1) {{(pid=103170) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 02:17:28.168548 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:17:28.169226 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:17:28.169662 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:17:28.172184 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:17:28.172821 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:17:28.173315 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:17:28.174159 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Registered counter for database nova_cell0 Aug 08 02:17:28.174900 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:17:28.175632 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:17:28.176080 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:17:28.178063 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:17:28.179502 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Registered counter for database nova_cell1 Aug 08 02:17:28.180098 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Registered counter for database nova_cell0 Aug 08 02:17:28.185744 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Registered counter for database nova_cell1 Aug 08 02:17:28.187481 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:17:28.189145 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:17:28.193583 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:17:28.194597 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:17:28.196890 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:17:28.199742 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:17:28.199856 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:17:28.338762 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Registered counter for database nova_cell0 Aug 08 02:17:28.339278 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:17:28.348185 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:17:28.348955 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Registered counter for database nova_cell0 Aug 08 02:17:28.352577 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:17:28.357458 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:17:28.363250 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:17:28.685117 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:17:28.690196 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:17:28.692194 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:17:28.697432 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:17:29.028872 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:17:29.035325 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:17:29.036487 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:17:29.040550 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b7e48159c0 pid: 103171 (default app) Aug 08 02:17:29.042435 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-93fefb9c-3ee5-4531-93bf-4a14b4e60f6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:17:29.042620 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:17:29.043781 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001724 Aug 08 02:17:29.044190 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Mon Aug 8 02:17:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:17:29.048213 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b7e48159c0 pid: 103170 (default app) Aug 08 02:18:44.400184 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:18:44.401477 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001705 Aug 08 02:18:44.402027 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:18:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:18:44.415529 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=3 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:44.419527 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell0:SELECT=3 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:44.420262 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell1:SELECT=3 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:44.421487 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:45.256341 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-6451a860-cbb9-472c-b036-b65bdbd216fb admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:18:45.287698 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-6451a860-cbb9-472c-b036-b65bdbd216fb admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.878685 Aug 08 02:18:45.288445 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1292 bytes} [Mon Aug 8 02:18:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:47.494708 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:18:47.495799 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-c59f02be-9bad-4c1a-9737-a701cb77b828 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 08 02:18:47.496140 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:18:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:18:47.961508 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-9c672713-b3a0-4fb9-a7c2-0c4b1625416a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "disk": 1}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:18:47.981337 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:18:47.981337 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Aug 08 02:18:48.010066 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-9c672713-b3a0-4fb9-a7c2-0c4b1625416a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.507828 Aug 08 02:18:48.010834 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1283 bytes} [Mon Aug 8 02:18:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:18:48.023984 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:48.025181 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell0:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:48.026130 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell1:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:48.026902 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:18:48.238080 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-b4e01343-e344-4b7d-b4ce-410632093d07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:18:48.242438 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:18:48.242438 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Aug 08 02:18:48.310656 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-b4e01343-e344-4b7d-b4ce-410632093d07 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291414 Aug 08 02:18:48.314375 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1336 bytes} [Mon Aug 8 02:18:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:50.529038 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-9c672713-b3a0-4fb9-a7c2-0c4b1625416a admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:18:50.531501 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-9c672713-b3a0-4fb9-a7c2-0c4b1625416a admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002501 Aug 08 02:18:50.532132 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:18:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:18:51.228874 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0f9b50f4-a6d2-4442-afe8-5c4651fb982e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "name": "ds512M", "disk": 5, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:18:51.250534 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:18:51.250534 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Aug 08 02:18:51.269870 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0f9b50f4-a6d2-4442-afe8-5c4651fb982e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.731221 Aug 08 02:18:51.270686 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1283 bytes} [Mon Aug 8 02:18:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:18:51.282943 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-81634ea1-7975-4858-80a5-304aeff1a340 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:18:51.285754 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:18:51.285754 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Aug 08 02:18:51.321695 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-81634ea1-7975-4858-80a5-304aeff1a340 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042971 Aug 08 02:18:51.322623 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1336 bytes} [Mon Aug 8 02:18:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:53.548214 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0f9b50f4-a6d2-4442-afe8-5c4651fb982e admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:18:53.549678 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0f9b50f4-a6d2-4442-afe8-5c4651fb982e admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002134 Aug 08 02:18:53.550548 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:18:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:18:53.916405 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-4b83e709-2f33-498f-ba1c-44ca6ae24b05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "disk": 10, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:18:53.934703 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-4b83e709-2f33-498f-ba1c-44ca6ae24b05 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.378576 Aug 08 02:18:53.935509 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1283 bytes} [Mon Aug 8 02:18:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 02:18:53.947986 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-9ebd1e26-7836-4d69-9dda-1d83b183085c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:18:53.971058 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-9ebd1e26-7836-4d69-9dda-1d83b183085c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026797 Aug 08 02:18:53.971810 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1336 bytes} [Mon Aug 8 02:18:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:18:56.137921 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-4b83e709-2f33-498f-ba1c-44ca6ae24b05 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:18:56.144591 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-4b83e709-2f33-498f-ba1c-44ca6ae24b05 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 08 02:18:56.144591 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:18:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:18:56.594538 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-e9bfc1ed-3e86-4c48-82d5-d03b922e8f58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10, "rxtx_factor": 1.0}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:18:56.614995 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-e9bfc1ed-3e86-4c48-82d5-d03b922e8f58 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.468669 Aug 08 02:18:56.615957 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1283 bytes} [Mon Aug 8 02:18:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:18:56.628170 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-9946c51e-132a-49bc-8c56-c90562c7d407 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:18:56.657438 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-9946c51e-132a-49bc-8c56-c90562c7d407 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032743 Aug 08 02:18:56.658554 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1336 bytes} [Mon Aug 8 02:18:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:18:58.876448 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-e9bfc1ed-3e86-4c48-82d5-d03b922e8f58 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:18:58.877459 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-e9bfc1ed-3e86-4c48-82d5-d03b922e8f58 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 08 02:18:58.879197 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:18:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:18:59.326984 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-5fda6686-90f2-4a74-83fa-556ee7486f59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "disk": 20, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:18:59.348631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-5fda6686-90f2-4a74-83fa-556ee7486f59 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464754 Aug 08 02:18:59.350792 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1283 bytes} [Mon Aug 8 02:18:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 02:18:59.361450 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-7d104430-dcfb-4bdf-9778-a0f6061e6c60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:18:59.387595 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-7d104430-dcfb-4bdf-9778-a0f6061e6c60 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029910 Aug 08 02:18:59.399268 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1336 bytes} [Mon Aug 8 02:18:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:19:01.602767 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-5fda6686-90f2-4a74-83fa-556ee7486f59 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:01.603777 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-5fda6686-90f2-4a74-83fa-556ee7486f59 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 08 02:19:01.604200 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:19:02.068857 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-8e44f3cf-ad0a-49e8-83af-6320c891ed45 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:02.101038 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-8e44f3cf-ad0a-49e8-83af-6320c891ed45 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.490646 Aug 08 02:19:02.101755 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1292 bytes} [Mon Aug 8 02:19:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:19:04.341637 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-5fda6686-90f2-4a74-83fa-556ee7486f59 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:04.342771 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-5fda6686-90f2-4a74-83fa-556ee7486f59 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Aug 08 02:19:04.343169 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:04.766529 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-5a881f78-aaff-463a-a9b8-9c855dd43bfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:04.785545 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-5a881f78-aaff-463a-a9b8-9c855dd43bfd admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.436283 Aug 08 02:19:04.786103 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1283 bytes} [Mon Aug 8 02:19:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 02:19:04.798594 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-d4b69044-cd50-46d4-9170-cce2e90d2aa8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:04.824309 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-d4b69044-cd50-46d4-9170-cce2e90d2aa8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029794 Aug 08 02:19:04.824910 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1333 bytes} [Mon Aug 8 02:19:04 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:06.987921 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-5a881f78-aaff-463a-a9b8-9c855dd43bfd admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:06.988930 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-5a881f78-aaff-463a-a9b8-9c855dd43bfd admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 08 02:19:06.989336 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:19:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:07.376279 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-5e77e5db-04da-48b6-bfea-b229a4c1f43f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "swap": 0, "name": "m1.small", "id": "2"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:07.396581 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-5e77e5db-04da-48b6-bfea-b229a4c1f43f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.401075 Aug 08 02:19:07.397045 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1283 bytes} [Mon Aug 8 02:19:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:19:07.409841 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-b9168482-a0e1-4b1d-8b76-d4cc0c5856ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:07.433321 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-b9168482-a0e1-4b1d-8b76-d4cc0c5856ce admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027188 Aug 08 02:19:07.433898 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1333 bytes} [Mon Aug 8 02:19:07 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:19:09.597980 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-5e77e5db-04da-48b6-bfea-b229a4c1f43f admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:09.599052 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-5e77e5db-04da-48b6-bfea-b229a4c1f43f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 08 02:19:09.599658 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:19:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:10.002800 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-8171f111-761a-4e79-8f3f-999b519112a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:10.022139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-8171f111-761a-4e79-8f3f-999b519112a7 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.416080 Aug 08 02:19:10.022805 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1283 bytes} [Mon Aug 8 02:19:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:19:10.035021 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-97a51012-4d88-4889-b7be-a88a31e1a758 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:10.064029 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-97a51012-4d88-4889-b7be-a88a31e1a758 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032750 Aug 08 02:19:10.064589 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1333 bytes} [Mon Aug 8 02:19:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:12.279070 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-8171f111-761a-4e79-8f3f-999b519112a7 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:12.280602 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-8171f111-761a-4e79-8f3f-999b519112a7 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Aug 08 02:19:12.281010 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:19:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:12.724467 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-ca82706b-e8e9-4067-8119-ef5525b1a8dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:12.743710 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-ca82706b-e8e9-4067-8119-ef5525b1a8dd admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456711 Aug 08 02:19:12.746396 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1283 bytes} [Mon Aug 8 02:19:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:19:12.756279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-a21c884c-cb94-4c1a-ab43-e3f31116f3e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:12.783873 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-a21c884c-cb94-4c1a-ab43-e3f31116f3e8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031314 Aug 08 02:19:12.784580 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1333 bytes} [Mon Aug 8 02:19:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:14.994770 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-ca82706b-e8e9-4067-8119-ef5525b1a8dd admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:14.995858 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-ca82706b-e8e9-4067-8119-ef5525b1a8dd admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001639 Aug 08 02:19:14.996332 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:15.462109 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-04e57499-f4e3-475e-b841-cdfd0ede41cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:15.485378 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-04e57499-f4e3-475e-b841-cdfd0ede41cc admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.482408 Aug 08 02:19:15.486353 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1283 bytes} [Mon Aug 8 02:19:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:19:15.500684 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-7dd78254-3b41-4b05-a1f8-6d155b0dbc94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:15.509309 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:15.529282 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-7dd78254-3b41-4b05-a1f8-6d155b0dbc94 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032228 Aug 08 02:19:15.546278 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1333 bytes} [Mon Aug 8 02:19:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:19:35.771012 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-04e57499-f4e3-475e-b841-cdfd0ede41cc admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:35.772009 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-04e57499-f4e3-475e-b841-cdfd0ede41cc admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 08 02:19:35.772401 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:19:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:36.156663 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-50a841cb-e459-4e17-9901-7e300f4e7979 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:36.174981 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-50a841cb-e459-4e17-9901-7e300f4e7979 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396762 Aug 08 02:19:36.175503 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1292 bytes} [Mon Aug 8 02:19:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:19:37.236159 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-04e57499-f4e3-475e-b841-cdfd0ede41cc admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:37.237163 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-04e57499-f4e3-475e-b841-cdfd0ede41cc admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 08 02:19:37.237561 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Aug 8 02:19:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:37.754725 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-e98c9cfa-568c-40d0-b6f1-09dd57f111bb admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:37.760210 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.wsgi [None req-e98c9cfa-568c-40d0-b6f1-09dd57f111bb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-e98c9cfa-568c-40d0-b6f1-09dd57f111bb admin admin] Request method failure captured: Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Accept: application/json Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Accept-Encoding: gzip, deflate Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Connection: keep-alive Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Content-Length: 0 Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Host: 10.222.0.39 Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Openstack-Api-Version: compute 2.90 Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Openstack-System-Scope: None Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: User-Agent: python-novaclient Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Auth-Token: gAAAAABi8HK5-BiOq0zteIPkKNtuYfr3KhKVlfEhqXS0vk0c7W6Kw1HCkprqKhjebmYbImL0GBcCtEQ9CHCBNWabf3zPSfdtKWwL9t2IHyuspZhVlbXBWcykdAOQSl0BXMS-sNFNNWpPYlUJmfrQs07JjfWQK9AOax2RPuP0MrQkMS5gLmkuMkw Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Domain-Id: None Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Domain-Name: None Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Identity-Status: Confirmed Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Is-Admin-Project: True Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Project-Domain-Id: default Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Project-Domain-Name: Default Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Project-Id: 520cd26c01a04fe5b710bc3899ff38a8 Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Project-Name: admin Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Role: reader,admin,member Aug 08 02:19:37.763449 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Roles: reader,admin,member Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/520cd26c01a04fe5b710bc3899ff38a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/520cd26c01a04fe5b710bc3899ff38a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_520cd26c01a04fe5b710bc3899ff38a8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/520cd26c01a04fe5b710bc3899ff38a8"}]}] Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Tenant: admin Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Tenant-Id: 520cd26c01a04fe5b710bc3899ff38a8 Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Tenant-Name: admin Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User: admin Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User-Domain-Id: default Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User-Domain-Name: Default Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User-Id: 2d716e3acbb54b2fa8e10b30ba8eb5fb Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User-Name: admin Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: method: > Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: exception: Flavor 42 could not be found. Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: action_args: {'id': '42'} Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:19:37.764972 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:19:37.765963 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:37.767550 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-e98c9cfa-568c-40d0-b6f1-09dd57f111bb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:19:37.768837 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-e98c9cfa-568c-40d0-b6f1-09dd57f111bb admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390169 Aug 08 02:19:37.768837 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Mon Aug 8 02:19:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:37.774468 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-7a26c113-7662-45a6-b68e-ebebbf2df23a admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:37.778667 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:19:37.799101 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-7a26c113-7662-45a6-b68e-ebebbf2df23a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028156 Aug 08 02:19:37.799638 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Mon Aug 8 02:19:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:19:37.809226 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-944dcb18-29d9-427e-9fb8-1f714a538538 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:37.832500 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-944dcb18-29d9-427e-9fb8-1f714a538538 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026906 Aug 08 02:19:37.833020 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Mon Aug 8 02:19:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:19:37.842602 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-26b93d23-bc99-4c0b-a7d3-c5ac9ca18b8c admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:37.848786 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-26b93d23-bc99-4c0b-a7d3-c5ac9ca18b8c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-26b93d23-bc99-4c0b-a7d3-c5ac9ca18b8c admin admin] Request method failure captured: Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Accept: application/json Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Connection: keep-alive Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Content-Length: 0 Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Host: 10.222.0.39 Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABi8HK5-BiOq0zteIPkKNtuYfr3KhKVlfEhqXS0vk0c7W6Kw1HCkprqKhjebmYbImL0GBcCtEQ9CHCBNWabf3zPSfdtKWwL9t2IHyuspZhVlbXBWcykdAOQSl0BXMS-sNFNNWpPYlUJmfrQs07JjfWQK9AOax2RPuP0MrQkMS5gLmkuMkw Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Domain-Id: None Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Domain-Name: None Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Project-Id: 520cd26c01a04fe5b710bc3899ff38a8 Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Project-Name: admin Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Role: reader,admin,member Aug 08 02:19:37.852090 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Roles: reader,admin,member Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/520cd26c01a04fe5b710bc3899ff38a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/520cd26c01a04fe5b710bc3899ff38a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_520cd26c01a04fe5b710bc3899ff38a8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/520cd26c01a04fe5b710bc3899ff38a8"}]}] Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Tenant: admin Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Tenant-Id: 520cd26c01a04fe5b710bc3899ff38a8 Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User: admin Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User-Id: 2d716e3acbb54b2fa8e10b30ba8eb5fb Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User-Name: admin Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: method: > Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: exception: Flavor 42 could not be found. Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: action_args: {'id': '42'} Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:19:37.853632 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:19:37.854530 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:37.855570 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-26b93d23-bc99-4c0b-a7d3-c5ac9ca18b8c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:19:37.856588 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-26b93d23-bc99-4c0b-a7d3-c5ac9ca18b8c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014939 Aug 08 02:19:37.856588 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Mon Aug 8 02:19:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:38.815110 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-944dcb18-29d9-427e-9fb8-1f714a538538 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:38.816160 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-944dcb18-29d9-427e-9fb8-1f714a538538 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 08 02:19:38.816548 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Aug 8 02:19:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:39.329583 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-d32edb91-3bfd-4d2d-8b94-d2b0146656c0 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:39.334857 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-d32edb91-3bfd-4d2d-8b94-d2b0146656c0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-d32edb91-3bfd-4d2d-8b94-d2b0146656c0 admin admin] Request method failure captured: Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Accept: application/json Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Connection: keep-alive Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Content-Length: 0 Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Host: 10.222.0.39 Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABi8HK6mHkLrMd1FeABGSBny2eYGb27aD6RbzUheFs6dSmupYUBNtwEjmngU4f8_adYnqswvCg5iWXAYHsyD1pXnzRV8c55btCuWFw5e3w2ZJ7UB3mB87XYMnC5v81LbxkmmaTMJjpEdHR_YfMlbUwTwsFjv3HpIz6xjOSCG1y_KueW8Kw Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Domain-Id: None Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Domain-Name: None Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Project-Id: 520cd26c01a04fe5b710bc3899ff38a8 Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Project-Name: admin Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Role: reader,admin,member Aug 08 02:19:39.336327 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Roles: reader,admin,member Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/520cd26c01a04fe5b710bc3899ff38a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/520cd26c01a04fe5b710bc3899ff38a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_520cd26c01a04fe5b710bc3899ff38a8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/520cd26c01a04fe5b710bc3899ff38a8"}]}] Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Tenant: admin Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Tenant-Id: 520cd26c01a04fe5b710bc3899ff38a8 Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User: admin Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User-Id: 2d716e3acbb54b2fa8e10b30ba8eb5fb Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User-Name: admin Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: method: > Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: exception: Flavor 84 could not be found. Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: action_args: {'id': '84'} Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:19:39.337877 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:19:39.338855 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:39.340139 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-d32edb91-3bfd-4d2d-8b94-d2b0146656c0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:19:39.341483 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-d32edb91-3bfd-4d2d-8b94-d2b0146656c0 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.383804 Aug 08 02:19:39.341483 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Mon Aug 8 02:19:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:39.347819 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-dc0e465f-b2d2-418e-91f8-fa0763914665 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:39.363135 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-dc0e465f-b2d2-418e-91f8-fa0763914665 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018942 Aug 08 02:19:39.363654 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Mon Aug 8 02:19:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:19:39.372712 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-37fcb704-5ae0-45dc-b489-6a9cdd11980a admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:39.387643 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-37fcb704-5ae0-45dc-b489-6a9cdd11980a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018342 Aug 08 02:19:39.388166 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Mon Aug 8 02:19:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:19:39.397015 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-159c9dd5-44ea-4ef6-9422-f1e894c6b2b4 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:39.402121 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.wsgi [None req-159c9dd5-44ea-4ef6-9422-f1e894c6b2b4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-159c9dd5-44ea-4ef6-9422-f1e894c6b2b4 admin admin] Request method failure captured: Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Accept: application/json Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Accept-Encoding: gzip, deflate Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Connection: keep-alive Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Content-Length: 0 Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Host: 10.222.0.39 Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Openstack-Api-Version: compute 2.90 Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Openstack-System-Scope: None Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: User-Agent: python-novaclient Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Auth-Token: gAAAAABi8HK6mHkLrMd1FeABGSBny2eYGb27aD6RbzUheFs6dSmupYUBNtwEjmngU4f8_adYnqswvCg5iWXAYHsyD1pXnzRV8c55btCuWFw5e3w2ZJ7UB3mB87XYMnC5v81LbxkmmaTMJjpEdHR_YfMlbUwTwsFjv3HpIz6xjOSCG1y_KueW8Kw Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Domain-Id: None Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Domain-Name: None Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Identity-Status: Confirmed Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Is-Admin-Project: True Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Project-Domain-Id: default Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Project-Domain-Name: Default Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Project-Id: 520cd26c01a04fe5b710bc3899ff38a8 Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Project-Name: admin Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Role: reader,admin,member Aug 08 02:19:39.403631 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Roles: reader,admin,member Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/520cd26c01a04fe5b710bc3899ff38a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/520cd26c01a04fe5b710bc3899ff38a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_520cd26c01a04fe5b710bc3899ff38a8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/520cd26c01a04fe5b710bc3899ff38a8"}]}] Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Tenant: admin Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Tenant-Id: 520cd26c01a04fe5b710bc3899ff38a8 Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Tenant-Name: admin Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User: admin Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User-Domain-Id: default Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User-Domain-Name: Default Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User-Id: 2d716e3acbb54b2fa8e10b30ba8eb5fb Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User-Name: admin Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: method: > Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: exception: Flavor 84 could not be found. Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: action_args: {'id': '84'} Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:19:39.405430 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:19:39.406217 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:39.407304 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-159c9dd5-44ea-4ef6-9422-f1e894c6b2b4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:19:39.408320 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-159c9dd5-44ea-4ef6-9422-f1e894c6b2b4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011925 Aug 08 02:19:39.408320 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Mon Aug 8 02:19:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:40.486454 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-37fcb704-5ae0-45dc-b489-6a9cdd11980a admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:40.487474 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-37fcb704-5ae0-45dc-b489-6a9cdd11980a admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 08 02:19:40.487859 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Aug 8 02:19:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:41.006863 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-40e477ce-966f-4e96-b031-8f9c76ac93a2 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:41.012498 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.wsgi [None req-40e477ce-966f-4e96-b031-8f9c76ac93a2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-40e477ce-966f-4e96-b031-8f9c76ac93a2 admin admin] Request method failure captured: Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Accept: application/json Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Accept-Encoding: gzip, deflate Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Connection: keep-alive Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Content-Length: 0 Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Host: 10.222.0.39 Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Openstack-Api-Version: compute 2.90 Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Openstack-System-Scope: None Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: User-Agent: python-novaclient Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Auth-Token: gAAAAABi8HK8a14_ki1n2NrdQkZ8FNjSAUUbcX2feCcDGpWGZ90WLg2ZyNtxE-UZvWgFu0qwD_ozFgHTguDFcb-0ja4wj_trSetVs8N3piMfi6BMe-5QbbMfhA8hGs2mqIKOBmL60M5T2KV_RAloJhenOKPg2-fzZG0cG8SM3a7NacFVgxWs8q0 Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Domain-Id: None Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Domain-Name: None Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Identity-Status: Confirmed Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Is-Admin-Project: True Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Project-Domain-Id: default Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Project-Domain-Name: Default Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Project-Id: 520cd26c01a04fe5b710bc3899ff38a8 Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Project-Name: admin Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Role: reader,admin,member Aug 08 02:19:41.014499 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Roles: reader,admin,member Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/520cd26c01a04fe5b710bc3899ff38a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/520cd26c01a04fe5b710bc3899ff38a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_520cd26c01a04fe5b710bc3899ff38a8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/520cd26c01a04fe5b710bc3899ff38a8"}]}] Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Tenant: admin Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Tenant-Id: 520cd26c01a04fe5b710bc3899ff38a8 Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-Tenant-Name: admin Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User: admin Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User-Domain-Id: default Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User-Domain-Name: Default Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User-Id: 2d716e3acbb54b2fa8e10b30ba8eb5fb Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: X-User-Name: admin Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: method: > Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: exception: Flavor 451 could not be found. Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: action_args: {'id': '451'} Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:19:41.016187 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:19:41.017220 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Aug 08 02:19:41.018604 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-40e477ce-966f-4e96-b031-8f9c76ac93a2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:19:41.019908 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-40e477ce-966f-4e96-b031-8f9c76ac93a2 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392069 Aug 08 02:19:41.019908 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Mon Aug 8 02:19:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 02:19:41.025436 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-10815d46-8786-4c8d-8e58-602bdcf4f6c8 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:41.041060 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-10815d46-8786-4c8d-8e58-602bdcf4f6c8 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019111 Aug 08 02:19:41.041578 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Mon Aug 8 02:19:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:19:41.050960 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:41.065814 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018376 Aug 08 02:19:41.066347 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Mon Aug 8 02:19:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:19:41.075193 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-64f1be0f-c130-4f27-bc2d-7d3dd12349cd admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:41.082796 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-64f1be0f-c130-4f27-bc2d-7d3dd12349cd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-64f1be0f-c130-4f27-bc2d-7d3dd12349cd admin admin] Request method failure captured: Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Accept: application/json Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Connection: keep-alive Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Content-Length: 0 Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Host: 10.222.0.39 Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABi8HK8a14_ki1n2NrdQkZ8FNjSAUUbcX2feCcDGpWGZ90WLg2ZyNtxE-UZvWgFu0qwD_ozFgHTguDFcb-0ja4wj_trSetVs8N3piMfi6BMe-5QbbMfhA8hGs2mqIKOBmL60M5T2KV_RAloJhenOKPg2-fzZG0cG8SM3a7NacFVgxWs8q0 Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Domain-Id: None Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Domain-Name: None Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Project-Id: 520cd26c01a04fe5b710bc3899ff38a8 Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Project-Name: admin Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Role: reader,admin,member Aug 08 02:19:41.084279 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Roles: reader,admin,member Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/520cd26c01a04fe5b710bc3899ff38a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/520cd26c01a04fe5b710bc3899ff38a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_520cd26c01a04fe5b710bc3899ff38a8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/520cd26c01a04fe5b710bc3899ff38a8"}]}] Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Tenant: admin Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Tenant-Id: 520cd26c01a04fe5b710bc3899ff38a8 Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User: admin Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User-Id: 2d716e3acbb54b2fa8e10b30ba8eb5fb Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: X-User-Name: admin Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: method: > Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: exception: Flavor 451 could not be found. Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: action_args: {'id': '451'} Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:19:41.086745 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:19:41.088068 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Aug 08 02:19:41.089105 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-64f1be0f-c130-4f27-bc2d-7d3dd12349cd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:19:41.090112 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-64f1be0f-c130-4f27-bc2d-7d3dd12349cd admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013863 Aug 08 02:19:41.090112 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Mon Aug 8 02:19:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 08 02:19:42.043115 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:42.044115 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 08 02:19:42.044507 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Aug 8 02:19:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:42.564863 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-4ff8b48c-beb4-4852-8925-747511cd0be3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:42.584164 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-4ff8b48c-beb4-4852-8925-747511cd0be3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.401926 Aug 08 02:19:42.584694 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Mon Aug 8 02:19:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:19:43.567782 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:43.568778 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 08 02:19:43.569165 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Aug 8 02:19:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:44.080794 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-4003657f-c7cb-488f-bae8-3fdcc6f6717a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:44.100020 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-4003657f-c7cb-488f-bae8-3fdcc6f6717a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.394809 Aug 08 02:19:44.100584 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Mon Aug 8 02:19:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 02:19:45.058018 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:45.059045 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 08 02:19:45.059439 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Aug 8 02:19:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:45.571415 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-02c3b23f-d7f1-493f-99ba-ae2c32fa37d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:45.590761 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-02c3b23f-d7f1-493f-99ba-ae2c32fa37d4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.393857 Aug 08 02:19:45.591289 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Mon Aug 8 02:19:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:19:46.548276 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:46.549302 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 08 02:19:46.549691 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Aug 8 02:19:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:47.061742 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-f3388030-08e7-4427-926d-8723dd780d1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:19:47.080464 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-f3388030-08e7-4427-926d-8723dd780d1d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.395017 Aug 08 02:19:47.080994 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Mon Aug 8 02:19:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:19:48.173618 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:48.174657 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 08 02:19:48.175058 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Aug 8 02:19:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:19:48.694450 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-ef1c0b05-79e8-4822-b172-3af32fdd9371 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:19:48.715281 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-ef1c0b05-79e8-4822-b172-3af32fdd9371 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404401 Aug 08 02:19:48.715750 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Mon Aug 8 02:19:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:20:39.429592 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:20:39.430630 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-47536918-0356-489f-b5d0-5a1168c68d85 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 08 02:20:39.431033 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 931 bytes} [Mon Aug 8 02:20:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:20:39.441853 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:39.815066 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-7e92a32e-bc13-42d2-b57d-9c4a8ca4a106 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:20:39.835636 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-7e92a32e-bc13-42d2-b57d-9c4a8ca4a106 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398209 Aug 08 02:20:39.836168 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1292 bytes} [Mon Aug 8 02:20:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:20:39.859882 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-22a6aad2-bf3f-4e3f-97b5-61853b7b4b0e admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:20:39.863295 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:20:39.868464 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-22a6aad2-bf3f-4e3f-97b5-61853b7b4b0e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012229 Aug 08 02:20:39.868980 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1283 bytes} [Mon Aug 8 02:20:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:20:39.880723 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-e33dfb2b-fa23-41e7-bafa-2b2b03d23d21 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:20:39.888834 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-e33dfb2b-fa23-41e7-bafa-2b2b03d23d21 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011610 Aug 08 02:20:39.889330 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1286 bytes} [Mon Aug 8 02:20:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:20:39.900658 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-0a100f2a-d8fe-44e6-b746-91c5114174d4 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:20:39.908697 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-0a100f2a-d8fe-44e6-b746-91c5114174d4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011800 Aug 08 02:20:39.909208 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1286 bytes} [Mon Aug 8 02:20:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:20:39.920332 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0992bbcc-dd5a-4f07-ba19-3248e6a14ec8 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:20:39.927663 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0992bbcc-dd5a-4f07-ba19-3248e6a14ec8 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010695 Aug 08 02:20:39.928156 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1283 bytes} [Mon Aug 8 02:20:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:23:29.445802 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-0a100f2a-d8fe-44e6-b746-91c5114174d4 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:23:29.446278 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-0a100f2a-d8fe-44e6-b746-91c5114174d4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 08 02:23:29.446670 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Aug 8 02:23:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:23:29.586410 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=6 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:29.745034 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-c28e917d-bf9d-4534-9fde-9526b41e7a8e admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:23:29.748016 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:23:29.748016 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Aug 08 02:23:29.749311 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-c28e917d-bf9d-4534-9fde-9526b41e7a8e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:23:29.749774 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-c28e917d-bf9d-4534-9fde-9526b41e7a8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:23:29.750197 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-c28e917d-bf9d-4534-9fde-9526b41e7a8e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:23:29.750918 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-c28e917d-bf9d-4534-9fde-9526b41e7a8e admin admin] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:23:29.751357 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-c28e917d-bf9d-4534-9fde-9526b41e7a8e admin admin] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:23:29.751761 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-c28e917d-bf9d-4534-9fde-9526b41e7a8e admin admin] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:23:29.784242 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-c28e917d-bf9d-4534-9fde-9526b41e7a8e admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.199284 Aug 08 02:23:29.784787 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1193 bytes} [Mon Aug 8 02:23:29 2022] GET /compute/v2.1/os-services => generated 794 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:23:30.601808 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-0a100f2a-d8fe-44e6-b746-91c5114174d4 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:23:30.602839 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-0a100f2a-d8fe-44e6-b746-91c5114174d4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 08 02:23:30.603258 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Aug 8 02:23:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:23:30.793072 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-17738491-ef33-45f3-8e55-bf87a2a085d6 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:23:30.795412 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:23:30.795412 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Aug 08 02:23:30.796532 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-17738491-ef33-45f3-8e55-bf87a2a085d6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:23:30.797001 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-17738491-ef33-45f3-8e55-bf87a2a085d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:23:30.797418 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-17738491-ef33-45f3-8e55-bf87a2a085d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:23:30.798114 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-17738491-ef33-45f3-8e55-bf87a2a085d6 admin admin] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:23:30.798587 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-17738491-ef33-45f3-8e55-bf87a2a085d6 admin admin] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:23:30.798993 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-17738491-ef33-45f3-8e55-bf87a2a085d6 admin admin] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:23:30.817953 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-17738491-ef33-45f3-8e55-bf87a2a085d6 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076118 Aug 08 02:23:30.818528 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 37/72] 10.222.0.39 () {60 vars in 1193 bytes} [Mon Aug 8 02:23:30 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:23:42.069325 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-0a100f2a-d8fe-44e6-b746-91c5114174d4 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:23:42.070360 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-0a100f2a-d8fe-44e6-b746-91c5114174d4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 08 02:23:42.070753 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 36/73] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Aug 8 02:23:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:23:42.216268 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell0:SELECT=4 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:42.225185 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell1:SELECT=4 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:42.225185 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=8 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:23:42.269324 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-f6654ffc-2160-4efc-b352-25a43fad65c8 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:23:42.271685 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:23:42.271685 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Aug 08 02:23:42.272771 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-f6654ffc-2160-4efc-b352-25a43fad65c8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:23:42.273237 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-f6654ffc-2160-4efc-b352-25a43fad65c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:23:42.273653 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-f6654ffc-2160-4efc-b352-25a43fad65c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:23:42.274377 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-f6654ffc-2160-4efc-b352-25a43fad65c8 admin admin] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:23:42.274814 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-f6654ffc-2160-4efc-b352-25a43fad65c8 admin admin] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:23:42.275219 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-f6654ffc-2160-4efc-b352-25a43fad65c8 admin admin] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:23:42.299270 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-f6654ffc-2160-4efc-b352-25a43fad65c8 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.087394 Aug 08 02:23:42.299743 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 38/74] 10.222.0.39 () {60 vars in 1193 bytes} [Mon Aug 8 02:23:42 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:23:43.118299 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-0a100f2a-d8fe-44e6-b746-91c5114174d4 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:23:43.119331 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-0a100f2a-d8fe-44e6-b746-91c5114174d4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 08 02:23:43.119752 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 37/75] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Aug 8 02:23:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:23:43.307271 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-b5b5e471-7a55-44ac-b0f5-5435646ce822 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:23:43.309626 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 02:23:43.309626 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Aug 08 02:23:43.310748 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-b5b5e471-7a55-44ac-b0f5-5435646ce822 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:23:43.311223 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-b5b5e471-7a55-44ac-b0f5-5435646ce822 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:23:43.311650 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-b5b5e471-7a55-44ac-b0f5-5435646ce822 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:23:43.312362 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-b5b5e471-7a55-44ac-b0f5-5435646ce822 admin admin] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:23:43.312806 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-b5b5e471-7a55-44ac-b0f5-5435646ce822 admin admin] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:23:43.313221 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-b5b5e471-7a55-44ac-b0f5-5435646ce822 admin admin] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:23:43.335119 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-b5b5e471-7a55-44ac-b0f5-5435646ce822 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079116 Aug 08 02:23:43.335617 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 39/76] 10.222.0.39 () {60 vars in 1193 bytes} [Mon Aug 8 02:23:43 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:24:41.675767 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: Mon Aug 8 02:24:41 2022 - graceful shutdown triggered... Aug 08 02:24:41.676251 dv-cinder-733062-33-iscsi devstack@n-api.service[103170]: Gracefully killing worker 1 (pid: 103170)... Aug 08 02:24:41.675894 dv-cinder-733062-33-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 08 02:24:41.677084 dv-cinder-733062-33-iscsi devstack@n-api.service[103171]: Gracefully killing worker 2 (pid: 103171)... Aug 08 02:24:42.676974 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: worker 1 buried after 1 seconds Aug 08 02:24:42.676974 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: worker 2 buried after 1 seconds Aug 08 02:24:42.676974 dv-cinder-733062-33-iscsi devstack@n-api.service[103169]: goodbye to uWSGI. Aug 08 02:24:42.678550 dv-cinder-733062-33-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 08 02:24:42.679104 dv-cinder-733062-33-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 08 02:24:42.681859 dv-cinder-733062-33-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 02:24:42.693848 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 02:24:42.695913 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 02:24:42 2022] *** Aug 08 02:24:42.695913 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 02:24:42.695913 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 02:24:42.695913 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: nodename: dv-cinder-733062-33-iscsi Aug 08 02:24:42.695913 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: machine: x86_64 Aug 08 02:24:42.695913 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: clock source: unix Aug 08 02:24:42.695913 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: pcre jit disabled Aug 08 02:24:42.695913 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: detected number of CPU cores: 4 Aug 08 02:24:42.695913 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: current working directory: / Aug 08 02:24:42.695913 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: detected binary path: /usr/bin/uwsgi-core Aug 08 02:24:42.695913 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: your processes number limit is 47680 Aug 08 02:24:42.696619 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: your memory page size is 4096 bytes Aug 08 02:24:42.696619 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: detected max file descriptor number: 2048 Aug 08 02:24:42.696619 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: lock engine: pthread robust mutexes Aug 08 02:24:42.696619 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: thunder lock: enabled Aug 08 02:24:42.696619 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 02:24:42.696619 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 02:24:42.737134 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: Python main interpreter initialized at 0x55e1512049c0 Aug 08 02:24:42.737134 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: python threads support enabled Aug 08 02:24:42.737134 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: your server socket listen backlog is limited to 100 connections Aug 08 02:24:42.737134 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: your mercy for graceful operations on workers is 90 seconds Aug 08 02:24:42.737589 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 02:24:42.737589 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: *** Operational MODE: preforking *** Aug 08 02:24:42.737867 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: *** uWSGI is running in multiple interpreter mode *** Aug 08 02:24:42.737867 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: spawned uWSGI master process (pid: 117620) Aug 08 02:24:42.738090 dv-cinder-733062-33-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 02:24:42.741013 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: spawned uWSGI worker 1 (pid: 117640, cores: 1) Aug 08 02:24:42.741013 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: spawned uWSGI worker 2 (pid: 117642, cores: 1) Aug 08 02:24:42.741013 dv-cinder-733062-33-iscsi devstack@n-api.service[117620]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 02:24:43.408930 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 02:24:43.447286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 02:24:44.557333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:24:44.557333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: from cryptography.utils import int_from_bytes Aug 08 02:24:44.557929 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:24:44.557929 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: from cryptography.utils import int_from_bytes Aug 08 02:24:44.628904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:24:44.628904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: from cryptography.utils import int_from_bytes Aug 08 02:24:44.629522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 02:24:44.629522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: from cryptography.utils import int_from_bytes Aug 08 02:24:46.880111 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:24:46.880630 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:24:46.880819 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:24:46.881171 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:24:46.881428 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:24:46.881816 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.882144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.882493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.882817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.883150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.883463 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.883784 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.884105 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.884436 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.884697 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.885014 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.885341 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-33-iscsi {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.885667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.885976 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.886880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.887198 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.887510 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.887834 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.888143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.888642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.889857 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.889857 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.889857 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.890125 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.890335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.890650 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.890971 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.891282 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.891609 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.891920 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.892317 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-33-iscsi {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.892638 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.892953 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.893271 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.893694 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.894010 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.894346 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.894673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.894999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.895308 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.895649 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.895974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.896303 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.896626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.896931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.897244 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.897751 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.898066 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.898408 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.899399 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.899399 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.899399 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.899648 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.899884 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.900207 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.900464 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.900718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.901040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.901363 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.901675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.902013 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.902346 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.902660 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.902971 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.903283 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.903590 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.903900 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.904223 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.904541 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.904868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.905179 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.905503 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.905902 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.906157 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.906494 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.906838 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.907162 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.907474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.907796 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.908119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.908434 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.908737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.909042 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.909366 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.909702 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.910009 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.910330 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.910587 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.910891 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.911211 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.911521 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.911829 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.912135 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.912437 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.912743 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.913049 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.913355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.913662 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.913969 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.914297 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.914608 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.914914 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.915219 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.915538 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.915859 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.916169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.916473 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.916780 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.917086 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.917405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.917736 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.918042 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.918391 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.918710 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.919002 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.919322 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.919629 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.919935 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.920253 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.920567 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.920863 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.921179 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.921486 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.921792 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.922095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.922423 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.923225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.923225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.923435 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.923615 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.924093 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.924422 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.924748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.925062 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.925373 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.925679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.926001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.926366 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.926705 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.927056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.927373 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.927707 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.928040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.928362 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.928675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.928993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.929320 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.929633 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.929945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.930277 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.930600 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.930922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.931299 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.931566 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.931885 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.932205 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.932518 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.932835 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.933685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.934096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.934363 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.934861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.935219 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.935526 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.935856 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.936188 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.936504 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.936825 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.937187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.937463 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.937795 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.938108 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.938453 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.939037 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.939348 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.939665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.939979 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.940318 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.940628 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.940954 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.941344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.941571 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.941878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.942191 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.942529 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.942843 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.943151 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.943457 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.943763 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.944074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.944411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.944910 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.945175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.945346 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.945646 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.945953 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.946326 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.946600 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.946951 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.947221 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.947536 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.947848 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.948155 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.948481 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.948849 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.949681 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.950010 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.950360 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.950662 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.950979 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.951294 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.951626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.951919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.952238 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.952567 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.952883 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.953199 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.956006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.956006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.956006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.956006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.956006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.956006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.956006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.956006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.958916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.958916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.958916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.958916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.958916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.958916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.958916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.958916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.960194 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.960194 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.960194 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.960194 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.960842 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 02:24:46.961740 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.961970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 02:24:46.962142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.962142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.962465 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 02:24:46.962618 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.962763 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 02:24:46.962914 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.963066 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 02:24:46.963210 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.963360 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.963512 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.963667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.963811 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.963963 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.964117 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.964268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.964422 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.964573 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.964723 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.964877 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.965028 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.965172 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.965322 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.965476 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.965629 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.965830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.966216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.966409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.966565 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.966709 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.966880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.967026 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-33-iscsi {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.967177 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.967321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.967547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.967698 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.967852 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.968006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.968150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.968312 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.968463 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.968615 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.968767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.968911 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.969063 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.969207 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.969357 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.969510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.969674 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.969836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.970056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.970275 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.970472 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.970667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.970667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.970667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.970667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.970667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.970667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.970667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.971988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.971988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.972349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.972349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-33-iscsi {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.972649 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.972800 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.972950 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.973094 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.973238 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.973394 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.973556 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.973706 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.973861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.974003 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.974154 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.974353 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.974524 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.974670 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.974981 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.975137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.975289 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.975448 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.975608 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.975753 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.975949 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.976349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.976512 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.976657 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.976815 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.976980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.977133 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.977278 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.977423 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.977598 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.977821 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.977970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.978113 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.978293 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.978456 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.978616 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.978768 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.978927 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.979079 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.979223 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.979366 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.979523 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.979667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.979818 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.979962 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.980189 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.980339 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.980493 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.980493 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.980791 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.980954 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.981217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.981399 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.981554 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.981700 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.981862 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.982194 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.982363 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.982521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.982667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.982810 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.982972 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.983116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.983273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.983417 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.983561 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.983704 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.983863 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.984007 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.984172 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.984315 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.984465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.984609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.984752 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.984905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.985062 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.985215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.985358 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.985509 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.985658 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.985802 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.986814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.986991 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.987140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.987284 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.987436 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.987587 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.987752 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.987982 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.988141 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.988294 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.988438 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.988667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.988822 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.988968 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.989110 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.989252 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.989395 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.989555 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.989555 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.989846 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.989991 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.990143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.990400 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.990563 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.990715 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.990860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.991002 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.991173 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.991398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.991556 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.991708 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.991852 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.992024 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.992335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.992501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.992654 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.992806 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.992957 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.993101 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.993246 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.993398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.993543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.993687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.993838 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.994001 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.994152 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.994330 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.994488 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.994638 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.994797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.994956 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.995106 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.995271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.995271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.995563 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.996235 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.996235 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.996647 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.996970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.997131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.997281 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.997441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.997592 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.997752 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.997904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.998142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.998335 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.998521 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.998673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.998838 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.999000 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.999150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.999308 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.999469 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.999619 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:46.999777 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:46.999940 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.000091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.000253 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.000419 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.000646 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.000810 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.000974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.001144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.001295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.001534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.001698 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.001858 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.002009 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.002159 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.002480 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.002638 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.002799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.002965 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.003122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.003291 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.003450 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.003601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.003760 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.003925 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.004084 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.004234 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.004467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.004631 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.004796 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.004955 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.005113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.005272 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.005439 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.005590 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.005755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.005914 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.006072 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.006315 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.006475 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.006656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.006912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.006912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.007374 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.007534 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.007684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.007855 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.008052 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.008287 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.008452 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.008603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 02:24:47.009273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.009453 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.009607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.009765 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.009917 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.010067 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.010235 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.010510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.010756 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.010922 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.011083 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.011242 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.012119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.012297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.012636 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.012803 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.012963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.013116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.013276 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.013434 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.013597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.013747 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.013904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.014055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.014214 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.014446 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.014607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.014757 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.014907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.015057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.015221 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.015371 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.015521 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.015688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.015847 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.016006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.016165 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.016364 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.016534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.016694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.016861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.017104 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.017363 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.017536 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.017772 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.017952 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.018111 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.018294 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.018533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.018533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.018833 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.018984 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.019133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.019297 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.019455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.019455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.019748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.019897 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.020064 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.020297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.020450 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.020608 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.020777 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.021004 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.021169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.021327 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.021486 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.021637 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.021797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.021956 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.022134 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.022397 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.022571 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.022875 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.023032 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.023194 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.023356 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.023356 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.023659 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.023816 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.023966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.023966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.024267 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.024267 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.024570 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.024721 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.024877 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.025036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.025187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.025336 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.025484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.025642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.025799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.025959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.026109 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.026286 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.026499 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.026674 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.026826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.027023 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.027267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.027508 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.027672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.027966 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.028123 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.028287 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.028445 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.028678 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.028845 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.029016 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.029177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.029336 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.029496 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.029647 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.029804 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.029956 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.030114 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.030312 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.030472 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.030636 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.030787 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.030787 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.031183 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.031346 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.031498 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.031648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.031798 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.031948 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.032118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.032268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.032441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.032664 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.033001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.033165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.033326 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.033489 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.033639 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.033797 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.033954 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.034114 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.034305 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.034484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.034667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.034946 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.035288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.035440 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.035589 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.035795 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.035961 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.036114 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.036274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.036424 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.036621 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.036777 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.036936 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.037096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.038151 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.038393 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.038559 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.038813 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.038972 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.039134 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.039295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.039446 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.039607 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.039759 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.039917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.040083 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.040242 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.040394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.040552 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.040703 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.040865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.041024 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.041193 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.041419 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.041585 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.041746 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.041907 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.042059 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.042217 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.042405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.042604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.042853 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.043197 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.043386 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.043550 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.043709 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.043868 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.044020 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.044179 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.044179 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.044472 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.044472 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.044764 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.044935 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.045212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.045400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.045568 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.045727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.045878 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.046037 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.046188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.046188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.046550 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.046746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.046901 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.047061 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.047219 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.047370 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.047632 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.047632 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.047937 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.048315 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.048489 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.048650 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.048821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.049049 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.049214 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.049379 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.049531 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.049531 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.049826 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.049988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.050153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.050343 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.050500 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.050651 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.050803 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.050965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.051135 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.051295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.051533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.051701 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.051861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.052019 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.052191 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.052344 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.052494 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.052651 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.052809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.053061 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.053320 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.053560 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.053727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.053727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.054024 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.054183 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.054374 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.054374 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.054673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.054822 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.054972 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.055134 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.055286 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.055435 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.055435 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.055926 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.056085 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.056319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.056489 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.056656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.056848 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.057020 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.057172 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.057335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.057494 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.057661 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.057890 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.058046 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.058893 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.059077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.059077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.059448 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.059611 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.059770 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.059937 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.060097 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.060257 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.060417 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.060568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.060718 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.060877 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.061028 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.061186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.061347 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.061516 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.061748 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.061915 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.062075 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.062226 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.062405 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.062405 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.062710 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.062870 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.063038 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.063291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.063515 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.064036 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.064209 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.064374 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.064526 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.064678 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.064828 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.064986 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.065214 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.065376 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.065536 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.065688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.065846 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.065996 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.066160 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.066366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.066520 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.066678 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.066903 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.067080 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.067241 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.067392 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.067549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.067708 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.067885 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.068152 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.068310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.068496 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.068668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.068835 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.069191 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.069439 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.069607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.069759 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.069917 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.070068 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.070392 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.070392 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.070713 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.070865 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.071021 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.071186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.071186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.071544 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.071695 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.071695 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.072117 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.072282 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.072442 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.072594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.072594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.072880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.073030 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.073030 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.073422 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.073676 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.074389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.074636 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.074636 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.074931 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.075095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.075247 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.075396 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.075554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.075554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.075554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.076012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.076165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.076165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.076463 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.076621 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.076785 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.076996 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.077162 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.077324 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.077476 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.077635 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.077800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.077800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.078131 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.078384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.078543 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.078694 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.078694 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.079011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.079324 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.079572 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.079737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.079737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.079737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.079737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.079737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.079737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.079737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.080756 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.080913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.081071 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.081285 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.081285 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.081595 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.081759 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.081930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.082149 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.082334 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.082560 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.082739 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.082901 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.082901 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.083187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.083350 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.083596 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.083847 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.084005 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.084156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.084306 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.084458 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.084622 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.084882 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.084882 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.085191 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.085350 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.085512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.085670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.085670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.085979 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.086130 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.086316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.086316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.086628 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.086786 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.086947 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.087141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.087310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.087461 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.087613 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.087771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.087921 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.088071 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.088235 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.088403 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.088643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.090120 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.090352 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.090535 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.090700 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.090861 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.091020 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.091179 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.091329 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.091493 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.091645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.091797 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.091954 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.092129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.092129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.092527 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.092681 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.092831 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.092982 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.093140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.093291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.093455 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.093624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.093864 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.094086 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.094267 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.094425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.094593 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.094766 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.095027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.095193 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.095346 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.095512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.095512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.095807 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.095807 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.096095 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.096095 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.096400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.096558 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.096731 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.096890 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.097056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.097316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.097482 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.097633 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.097791 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.097951 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.098109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.098292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.098450 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.098630 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.098869 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.099027 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.099178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.099361 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.099677 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.099843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.100020 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.100249 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.100406 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.100571 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.100732 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.100896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.101056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.101228 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.101386 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.101545 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.101545 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.102546 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.102724 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.102892 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.103045 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.103195 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.103346 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.103496 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.103654 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.103835 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.104086 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.104319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.104484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.104636 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.104801 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.104801 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.105719 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.105887 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.106040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.106192 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.106514 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.106674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.106846 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.106998 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.107159 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.107359 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.107531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.107684 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.107834 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.107992 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.108143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.108301 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.108301 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.108597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.108755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.108969 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.109126 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.109287 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.109440 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.109440 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.109440 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.110062 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.110240 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.110491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.110656 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.110808 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.111057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.111216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.111364 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.111493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.111609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.111609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.111833 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.111952 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.112073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.112193 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.112305 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.112416 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.112555 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.112751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.112900 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.113033 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.113033 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.113288 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.113418 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.113547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.113686 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.113818 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.113947 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.114092 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.114324 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.114537 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.114679 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.114793 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.114934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.115073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.115210 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.115352 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.115482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.115594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.115723 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.115928 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.116046 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.116830 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.116989 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.117310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.117504 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.117643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.117774 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.117903 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.118026 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.118416 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.118559 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.118690 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.118823 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.118954 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.119065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.119198 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.119337 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.119476 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.119607 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.119607 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.119867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.120103 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.120346 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.120506 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.120732 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.120732 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.121012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.121233 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.121367 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.121522 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.121665 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.121804 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.121949 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.122081 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.122202 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.122202 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.122202 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.122970 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.123119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.123260 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.123389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.123502 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.123664 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.123797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.123942 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.124081 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.124213 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.124446 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.124707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.124837 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.124964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.125079 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.125198 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.125198 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.125422 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.125549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.125549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.125549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.125916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.126159 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.126310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.126459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.126588 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.126833 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.126987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.127122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.127122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.127122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.127550 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.127693 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.127825 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.127955 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.127955 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.128222 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.128354 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.128485 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.128622 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.128622 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.128916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.129050 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.129050 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.129296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.129426 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.129518 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.129602 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.129689 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.129773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.129773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.130242 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.130438 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.130438 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.130622 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.130720 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.130796 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.130867 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.130867 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.131017 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.131091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.131091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.131091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.132339 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.132443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.132443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.132586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.132659 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.132659 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.132793 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.132906 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.133110 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.133203 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.133203 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.133342 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.133435 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.133435 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.133435 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.133685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.133807 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.133807 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.133992 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.134079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.134170 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.134490 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.134490 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.134687 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.134789 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.135060 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.135177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.135177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.135343 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.135416 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.135416 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.135594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.135675 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.135763 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.135847 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.135847 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.136006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.136093 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.136195 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.136307 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.136307 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.136477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.136571 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.136571 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.136727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.136811 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.137097 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.137203 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.137291 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.137400 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.137488 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.137699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.137789 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.137884 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.137979 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.138071 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.138165 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.138281 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.138388 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.138482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.138562 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.138647 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.138647 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.138807 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.138901 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.138901 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.139055 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.139055 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.139208 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.139291 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.139389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.139389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.139553 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.139645 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.139737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.139822 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.139915 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.140001 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.140001 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.140153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.140232 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.140311 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.140385 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.140481 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.140574 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.140660 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.140750 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.140843 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.140917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.141001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.141085 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.141175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.141261 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.141358 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.141443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.141527 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.141618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.141710 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.141795 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.141912 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.142002 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.142095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.142187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.142298 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.142395 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.142488 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.142581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.142667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.142759 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.142845 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.143001 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.143001 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.143184 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.143271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.143355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.143439 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.143536 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.143622 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.143714 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.143799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.143892 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.143979 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.144076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.144162 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.144246 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.144331 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.144415 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.144513 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.144599 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.144679 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.144750 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.144841 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.145115 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.145216 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.145304 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.145388 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.145472 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.145564 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.145655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.145760 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.145854 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.145947 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.146058 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.146162 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.146404 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.146510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.146718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.146813 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.147045 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.147186 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.147353 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.147458 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.147696 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.147810 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.148001 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.148096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.148328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.148431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.148635 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.148732 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.148955 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.149056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.149269 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.149363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.149581 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.149674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.149891 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.149994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.150201 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.150353 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.150536 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.150638 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.150846 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.150952 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.151161 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.151280 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.151471 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.151577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.151785 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.152435 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.152627 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.152743 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.152946 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.153048 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.153280 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.153514 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.153610 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.153841 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.153936 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.154157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.154281 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.154495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.154602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.154808 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.154911 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.155124 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.155273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.155434 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.155552 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.155741 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.155832 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.156056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.156213 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.156357 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.156499 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.156664 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.156749 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.157804 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.157923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.157999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.158070 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.158141 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.158219 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.158333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.158410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.158488 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.158568 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.158640 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.158710 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.158866 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.158952 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.159238 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.159330 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.159527 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.159621 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.159873 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.159964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.160205 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.160307 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.160520 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.160627 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.160906 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.161021 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.161129 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.161224 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.161373 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:24:47.161477 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.161729 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.162042 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.162390 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.162728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.163006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.163318 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.163629 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.163947 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.164287 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.164606 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.165062 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.165238 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.165571 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.166230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.166584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.166924 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.167256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.168125 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.168455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.168778 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.169113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.169423 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.169731 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.170042 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.170379 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.170688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.171012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.171327 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.171634 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.171954 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.172264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.172854 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.173205 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.173525 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.173852 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.174182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.174532 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.174868 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.175204 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.175510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.175816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.176133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.176447 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.176753 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.177058 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.177370 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.177681 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.177984 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.178351 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.178629 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.178962 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.179265 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.179568 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.179873 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.180183 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.180486 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.180799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.181094 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.181398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.181794 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.182104 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.182445 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.182750 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.183059 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.183396 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.183704 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.184006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.184338 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.184645 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.185019 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.185344 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.185654 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.185974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.186310 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.186624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.186979 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.187295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.187888 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.188222 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.188543 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.189149 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.189483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.189793 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.190098 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.190430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.190758 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.191073 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.191382 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.191696 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.192006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.192317 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.192627 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.192938 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.193247 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.193555 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.193864 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.194170 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.194517 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.194828 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.195136 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.195454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.195807 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.196127 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.196443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.196758 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.197071 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.197379 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.197688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.197998 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.198329 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.198644 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.199023 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.199339 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.199642 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.200083 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.200395 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.200717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.201122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.201348 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.201669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.201992 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.202328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.202653 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.202964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.203295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.203640 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.203974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.204300 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.204606 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.204912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.205217 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.205527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.205849 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.206157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.206558 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.206866 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.207180 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.207482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.207791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.208094 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.208398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.208712 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.209016 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.209319 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.209622 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.209925 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.210230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.210554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.210863 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.211273 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.211467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.211771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.212075 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.212380 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.212716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.213048 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.213367 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.213688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.213999 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.214860 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.215184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.215543 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.215868 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.216191 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.216502 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.216835 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.217144 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.217455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.217766 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.218077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.218412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.218722 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.219060 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.219386 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.219693 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.220018 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.220334 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.220657 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.220974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.221285 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.221614 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.221923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.222232 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.222565 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.222876 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.223182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.223497 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.223806 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.224115 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.224433 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.224747 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.225076 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.225400 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.225710 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.226034 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.226383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.226740 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.227055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.227402 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.227729 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.228045 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.228355 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.228681 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 02:24:47.228907 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 02:24:47.313252 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO dbcounter [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Registered counter for database nova_api Aug 08 02:24:47.334625 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_db.sqlalchemy.engines [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:47.342453 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writer thread running {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:47.383139 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO dbcounter [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Registered counter for database nova_api Aug 08 02:24:47.400374 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.context [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c42a8d5-6ffe-4953-b1e2-c735d79966d9(cell1) {{(pid=117642) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 02:24:47.403782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_db.sqlalchemy.engines [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:47.405012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:24:47.405523 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:24:47.407116 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:24:47.407866 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:24:47.408320 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:24:47.410387 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:24:47.410658 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writer thread running {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:47.412446 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO dbcounter [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Registered counter for database nova_cell0 Aug 08 02:24:47.416753 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO dbcounter [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Registered counter for database nova_cell1 Aug 08 02:24:47.425024 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_db.sqlalchemy.engines [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:47.426109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_db.sqlalchemy.engines [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:47.434954 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writer thread running {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:47.435301 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writer thread running {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:47.467900 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.context [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c42a8d5-6ffe-4953-b1e2-c735d79966d9(cell1) {{(pid=117640) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 02:24:47.471960 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:24:47.472438 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:24:47.474004 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:24:47.474761 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:24:47.475215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:24:47.477171 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:24:47.479209 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO dbcounter [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Registered counter for database nova_cell0 Aug 08 02:24:47.483785 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO dbcounter [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Registered counter for database nova_cell1 Aug 08 02:24:47.491494 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_db.sqlalchemy.engines [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:47.493186 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_db.sqlalchemy.engines [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:47.500046 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writer thread running {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:47.501335 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writer thread running {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:47.581103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO dbcounter [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Registered counter for database nova_cell0 Aug 08 02:24:47.587831 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_db.sqlalchemy.engines [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:47.592344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writer thread running {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:47.645455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO dbcounter [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Registered counter for database nova_cell0 Aug 08 02:24:47.652426 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_db.sqlalchemy.engines [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 02:24:47.657083 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writer thread running {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 02:24:47.907394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: WARNING keystonemiddleware.auth_token [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:24:47.914576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: WARNING keystonemiddleware.auth_token [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:24:47.971605 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: WARNING keystonemiddleware.auth_token [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:24:47.981537 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: WARNING keystonemiddleware.auth_token [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:24:48.268164 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: WARNING keystonemiddleware.auth_token [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:24:48.274110 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: WARNING keystonemiddleware.auth_token [None req-2c7e90f5-68f3-4c24-a034-c0da3d5f68ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:24:48.280436 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1512049c0 pid: 117642 (default app) Aug 08 02:24:48.317951 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: WARNING keystonemiddleware.auth_token [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 02:24:48.323968 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: WARNING keystonemiddleware.auth_token [None req-c0b6eac1-b141-49e8-910d-361419c2dba9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 02:24:48.330198 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1512049c0 pid: 117640 (default app) Aug 08 02:25:22.549718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:22.550760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:22.551594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:22.555356 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:23.400126 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-46ff4b57-e7a9-4b52-8be1-8c0b264b7efd tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Action: 'create', calling method: .version_select at 0x7f3297a19dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2067829520"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:23.704852 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=3 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:23.706016 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=3 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:23.706802 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=3 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:23.708239 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=3 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:25.293190 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-81e8469a-dbba-4301-94b3-3d7e3ec1c8b2 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Action: 'create', calling method: .version_select at 0x7f3297a1adc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1309276603", "metadata": {"Type": "work"}}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:25.396535 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-46ff4b57-e7a9-4b52-8be1-8c0b264b7efd tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.852609 Aug 08 02:25:25.397522 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1155 bytes} [Mon Aug 8 02:25:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2856 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 02:25:25.412008 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-09f3478c-be1e-4a5e-8f5d-e13ee93578f2 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f3297909c10>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:25.715442 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-09f3478c-be1e-4a5e-8f5d-e13ee93578f2 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922" status: 200 len: 345 microversion: 2.1 time: 0.307607 Aug 08 02:25:25.716491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 2/2] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:25 2022] GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922 => generated 345 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:26.738302 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3542f1f1-9794-4552-811a-7c47dfc89399 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978ac310>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:26.850744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-81e8469a-dbba-4301-94b3-3d7e3ec1c8b2 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.153989 Aug 08 02:25:26.861432 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1156 bytes} [Mon Aug 8 02:25:23 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3169 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 02:25:26.862578 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3542f1f1-9794-4552-811a-7c47dfc89399 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922" status: 200 len: 345 microversion: 2.1 time: 0.137476 Aug 08 02:25:26.863880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 3/4] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:26 2022] GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922 => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:25:26.872892 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d20ebe5c-f0f5-4aae-bc1f-e55079a41f2b tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Calling method '.version_select at 0x7f3297908c10>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:27.025422 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d20ebe5c-f0f5-4aae-bc1f-e55079a41f2b tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241" status: 200 len: 353 microversion: 2.1 time: 0.162597 Aug 08 02:25:27.031912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 2/5] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:26 2022] GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241 => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:27.883690 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c2f0f0c5-4018-4120-909c-4c3b54c74c99 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978ac9d0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:28.005904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c2f0f0c5-4018-4120-909c-4c3b54c74c99 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922" status: 200 len: 346 microversion: 2.1 time: 0.132753 Aug 08 02:25:28.006870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 4/6] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:27 2022] GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922 => generated 346 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:28.019676 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d0df3308-0dfe-49f4-9090-1780192eb24f tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Action: 'create', calling method: .version_select at 0x7f32978a7280>, body: {"snapshot": {"volume_id": "df9f4d37-9811-4cd4-9a1c-6830ed5b0922", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-385648823"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:28.043408 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-25d6082e-7930-4411-ae14-53ced4147cd0 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Calling method '.version_select at 0x7f3297909dc0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:28.141959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-25d6082e-7930-4411-ae14-53ced4147cd0 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241" status: 200 len: 354 microversion: 2.1 time: 0.105870 Aug 08 02:25:28.142813 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 5/7] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:28 2022] GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241 => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:28.160355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b05ab30a-79d7-4ecb-8382-72529dee7096 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Calling method '.version_select at 0x7f32978aca60>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:28.362701 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b05ab30a-79d7-4ecb-8382-72529dee7096 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241" status: 200 len: 354 microversion: 2.1 time: 0.208996 Aug 08 02:25:28.405462 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 6/8] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:28 2022] GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241 => generated 354 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:25:28.405462 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9d0f1272-8ec1-43eb-915b-b561d9e93c42 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Calling method '.version_select at 0x7f32978ac310>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:28.496563 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d0df3308-0dfe-49f4-9090-1780192eb24f tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.480641 Aug 08 02:25:28.503623 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 3/9] 10.222.0.39 () {60 vars in 1162 bytes} [Mon Aug 8 02:25:28 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:28.509792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fdbeab3c-0aee-4e14-b3e5-1ef4cf6a6c9e tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978aa4c0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:28.518608 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9d0f1272-8ec1-43eb-915b-b561d9e93c42 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241" status: 202 len: 0 microversion: 2.1 time: 0.145076 Aug 08 02:25:28.522044 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 7/10] 10.222.0.39 () {58 vars in 1248 bytes} [Mon Aug 8 02:25:28 2022] DELETE /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:25:28.528786 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c9ed14d5-9568-494e-aeb2-61d6076a8e39 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Calling method '.version_select at 0x7f32978ac0d0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:28.676717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fdbeab3c-0aee-4e14-b3e5-1ef4cf6a6c9e tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722" status: 200 len: 286 microversion: 2.1 time: 0.171705 Aug 08 02:25:28.683974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 4/11] 10.222.0.39 () {58 vars in 1251 bytes} [Mon Aug 8 02:25:28 2022] GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722 => generated 286 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:28.689965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-056a5516-3b5e-4473-b11f-ba79fbf5d78b tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978a7d30>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:28.692016 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c9ed14d5-9568-494e-aeb2-61d6076a8e39 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241" status: 200 len: 353 microversion: 2.1 time: 0.168309 Aug 08 02:25:28.692827 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 8/12] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:28 2022] GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241 => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:25:28.822039 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-056a5516-3b5e-4473-b11f-ba79fbf5d78b tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.136603 Aug 08 02:25:28.823285 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 5/13] 10.222.0.39 () {58 vars in 1140 bytes} [Mon Aug 8 02:25:28 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:28.834291 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-199b30b5-39df-4eab-99f6-676008d84030 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978ac940>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:28.877507 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-199b30b5-39df-4eab-99f6-676008d84030 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722" status: 200 len: 286 microversion: 2.1 time: 0.046943 Aug 08 02:25:28.878291 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 9/14] 10.222.0.39 () {58 vars in 1251 bytes} [Mon Aug 8 02:25:28 2022] GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:25:29.709698 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-41e22d29-7484-4ba9-9e2f-5f9889ad8c9d tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Calling method '.version_select at 0x7f3297908af0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:29.830905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-41e22d29-7484-4ba9-9e2f-5f9889ad8c9d tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241" status: 200 len: 353 microversion: 2.1 time: 0.128656 Aug 08 02:25:29.831653 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 6/15] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:29 2022] GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:29.889826 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1ab30c45-88db-43bd-8f62-06e5e74bb2a9 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f3297909b80>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:29.960084 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1ab30c45-88db-43bd-8f62-06e5e74bb2a9 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722" status: 200 len: 286 microversion: 2.1 time: 0.074438 Aug 08 02:25:29.960910 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 10/16] 10.222.0.39 () {58 vars in 1251 bytes} [Mon Aug 8 02:25:29 2022] GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:30.845431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0058c400-6753-4abf-856c-6967a2580d68 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Calling method '.version_select at 0x7f32978aa1f0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:30.976940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9a3491fa-3ddd-4dfe-a22f-1114987cad24 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f3297909ca0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:30.978786 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0058c400-6753-4abf-856c-6967a2580d68 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241" status: 200 len: 353 microversion: 2.1 time: 0.137023 Aug 08 02:25:30.980777 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 7/17] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:30 2022] GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241 => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:31.052358 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9a3491fa-3ddd-4dfe-a22f-1114987cad24 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722" status: 200 len: 286 microversion: 2.1 time: 0.082486 Aug 08 02:25:31.052940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 11/18] 10.222.0.39 () {58 vars in 1251 bytes} [Mon Aug 8 02:25:30 2022] GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:25:31.996313 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-eb2753ec-2409-40d0-8d30-2d11665eed0d tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Calling method '.version_select at 0x7f3297908e50>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:32.067637 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-75277191-4531-4889-916d-88949d704378 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978ac940>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:32.142820 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-75277191-4531-4889-916d-88949d704378 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722" status: 200 len: 286 microversion: 2.1 time: 0.081471 Aug 08 02:25:32.144325 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 12/19] 10.222.0.39 () {58 vars in 1251 bytes} [Mon Aug 8 02:25:32 2022] GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:32.148568 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-eb2753ec-2409-40d0-8d30-2d11665eed0d tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241" status: 200 len: 353 microversion: 2.1 time: 0.154030 Aug 08 02:25:32.155770 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 8/20] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:31 2022] GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241 => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:33.155993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c22c74aa-d305-4341-9c96-6224bd3f9916 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978ac040>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:33.166209 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0c46ba5f-6468-463c-ab1b-93956e70bc96 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Calling method '.version_select at 0x7f32978a7160>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:33.249779 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c22c74aa-d305-4341-9c96-6224bd3f9916 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722" status: 200 len: 286 microversion: 2.1 time: 0.097933 Aug 08 02:25:33.255515 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 13/21] 10.222.0.39 () {58 vars in 1251 bytes} [Mon Aug 8 02:25:33 2022] GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:33.301059 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0c46ba5f-6468-463c-ab1b-93956e70bc96 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241" status: 200 len: 353 microversion: 2.1 time: 0.141207 Aug 08 02:25:33.302310 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 9/22] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:33 2022] GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:34.264305 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6f54e90d-3b88-4322-a6e8-4b7736dafb47 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978b93a0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:34.316977 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-84a76a49-2cfd-43fc-86c7-f7b83bab2fa0 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Calling method '.version_select at 0x7f32978a79d0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:34.383311 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6f54e90d-3b88-4322-a6e8-4b7736dafb47 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722" status: 200 len: 286 microversion: 2.1 time: 0.123717 Aug 08 02:25:34.384221 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 14/23] 10.222.0.39 () {58 vars in 1251 bytes} [Mon Aug 8 02:25:34 2022] GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722 => generated 286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:34.466930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-84a76a49-2cfd-43fc-86c7-f7b83bab2fa0 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241" status: 200 len: 353 microversion: 2.1 time: 0.154181 Aug 08 02:25:34.474183 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 10/24] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:34 2022] GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241 => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:35.396130 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9bec653e-d0f3-4d45-b8f2-f812971d0402 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978aa0d0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:35.469265 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9bec653e-d0f3-4d45-b8f2-f812971d0402 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722" status: 200 len: 287 microversion: 2.1 time: 0.076817 Aug 08 02:25:35.470032 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 11/25] 10.222.0.39 () {58 vars in 1251 bytes} [Mon Aug 8 02:25:35 2022] GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:35.483945 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-84acab4b-eecf-4319-8f46-a47b1651c7a1 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Calling method '.version_select at 0x7f32978a7af0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:35.582236 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-84acab4b-eecf-4319-8f46-a47b1651c7a1 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] HTTP exception thrown: Volume 32112e01-4469-46f9-959d-867419ecd241 could not be found. Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-84acab4b-eecf-4319-8f46-a47b1651c7a1 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Request method failure captured: Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241 HTTP/1.1 Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQTftUgOofKlE1UNH3IyxF80iyo4cEJKfHpC-Gb33JkQICKSmKOB3GkX9pK-lyuzaOBKUvjI00NXuIAZw4rn_pzY19V4t1YX7JoVeecavOba8Y5UC0gRU5lFyZyASEXLxWkbn1w-znJu5sj5oaW6pl4DMeG1OZDgzcPKe1gQm_a8vk Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: bc649f835360455ba6e67121cd31586e Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-VolumesGetTestJSON-2010895824 Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:25:35.587295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bc649f835360455ba6e67121cd31586e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc649f835360455ba6e67121cd31586e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bc649f835360455ba6e67121cd31586e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc649f835360455ba6e67121cd31586e"}]}] Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-VolumesGetTestJSON-2010895824 Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: bc649f835360455ba6e67121cd31586e Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-VolumesGetTestJSON-2010895824 Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-VolumesGetTestJSON-2010895824-project Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 405f0adce9b24b51b874b27d516a2b1f Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-VolumesGetTestJSON-2010895824-project Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Volume 32112e01-4469-46f9-959d-867419ecd241 could not be found. Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '32112e01-4469-46f9-959d-867419ecd241'} Aug 08 02:25:35.589030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32112e01-4469-46f9-959d-867419ecd241 could not be found. (HTTP 404) (Request-ID: req-c71c008a-bbff-4f84-8b7d-3cac0865b590) Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:35.589669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:25:35.590604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32112e01-4469-46f9-959d-867419ecd241 could not be found. Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 02:25:35.591549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:25:35.592406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32112e01-4469-46f9-959d-867419ecd241 could not be found. Aug 08 02:25:35.592406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:35.592406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:35.592406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:35.592406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:35.592406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:35.592406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:35.592406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:25:35.592406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:25:35.592406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32112e01-4469-46f9-959d-867419ecd241 could not be found. Aug 08 02:25:35.592406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:35.595460 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-84acab4b-eecf-4319-8f46-a47b1651c7a1 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] Returning 404 to user: Volume 32112e01-4469-46f9-959d-867419ecd241 could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:25:35.596569 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-84acab4b-eecf-4319-8f46-a47b1651c7a1 tempest-VolumesGetTestJSON-2010895824 tempest-VolumesGetTestJSON-2010895824-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241" status: 404 len: 109 microversion: 2.1 time: 0.119096 Aug 08 02:25:35.597745 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 12/26] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:35 2022] GET /compute/v2.1/os-volumes/32112e01-4469-46f9-959d-867419ecd241 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:25:35.604251 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-06a44bf7-6633-4840-9205-0492d0cb6f55 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978a7550>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:35.678589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f053c45c-4944-477e-947b-e56b2f8ea607 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: .version_select at 0x7f3297909e50>, body: {"keypair": {"name": "tempest-keypair-1385408535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU3HpO7NtJF+QlHwdKFf9XbHXqTdn5qaLVgWz8FvVOVekuzol1/PifZhhVdNOjycIgq2I+ipfu/hq385WeM9Aj9frl322tPHTbchv+9elcEI2hXqhh/VyFHfPvaqZLwMA=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:35.777724 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-06a44bf7-6633-4840-9205-0492d0cb6f55 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722" status: 202 len: 0 microversion: 2.1 time: 0.178448 Aug 08 02:25:35.778316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 13/27] 10.222.0.39 () {58 vars in 1254 bytes} [Mon Aug 8 02:25:35 2022] DELETE /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:25:35.790586 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-95ac79af-3df3-4ab3-b4f2-00e4c75fbdb3 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978aa940>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:35.840261 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-f053c45c-4944-477e-947b-e56b2f8ea607 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:25:35.862148 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-95ac79af-3df3-4ab3-b4f2-00e4c75fbdb3 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722" status: 200 len: 286 microversion: 2.1 time: 0.079519 Aug 08 02:25:35.863983 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 14/28] 10.222.0.39 () {58 vars in 1251 bytes} [Mon Aug 8 02:25:35 2022] GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:25:35.866846 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-f053c45c-4944-477e-947b-e56b2f8ea607 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for user 43dd72b161f8442285dea411741d66b3 and project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:25:36.003157 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f053c45c-4944-477e-947b-e56b2f8ea607 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.906919 Aug 08 02:25:36.011622 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 15/29] 10.222.0.39 () {60 vars in 1159 bytes} [Mon Aug 8 02:25:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:36.437081 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-34789c80-a8e5-4c40-96d1-f70eab5683fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Action: 'create', calling method: .version_select at 0x7f32978aa160>, body: {"keypair": {"name": "tempest-keypair-1725379006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPq/ONYY+w5gVWT2xxD5Wx1T3FTSGsJdXRA3lmwxaEe7YKA0W+hQldcgjK0eN5hJcsS6mqlS74SXHDTcifQ4X6D3IMMo/VPYPnicsflmV5iQG3uH3u15vJ5g3VRnh4Y6Q=="}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:36.546891 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-34789c80-a8e5-4c40-96d1-f70eab5683fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Getting quotas for project 9ae7098cc9f24d9dbc4695789c5b87b4. Resources: {'key_pairs'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:25:36.600312 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-34789c80-a8e5-4c40-96d1-f70eab5683fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Getting quotas for user 17286ff2e1764ec7b91e6274c7162437 and project 9ae7098cc9f24d9dbc4695789c5b87b4. Resources: {'key_pairs'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:25:36.734614 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-34789c80-a8e5-4c40-96d1-f70eab5683fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.554885 Aug 08 02:25:36.737628 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 15/30] 10.222.0.39 () {60 vars in 1159 bytes} [Mon Aug 8 02:25:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:36.899121 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4b2432b3-a528-4aba-bc8e-9df4f28058c7 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978343a0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:36.955962 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-4b2432b3-a528-4aba-bc8e-9df4f28058c7 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] HTTP exception thrown: Snapshot 696bea77-b93c-4761-9276-7722bbbbb722 could not be found. Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4b2432b3-a528-4aba-bc8e-9df4f28058c7 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Request method failure captured: Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722 HTTP/1.1 Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQSgKUmEflhEyNIJmCxeG-ETrk5DqO6W8zbdXJ0hkrrYdLFAYm3CwOLaH1_R757B1cA5ivQPkuwhw8kq8yr1P8i_dI2CI4IzjMlDqYtudWCXpZ84zQZ5_E_ueWrPRfgTjMaemQ5G48Vf55EHmOTAgWl0aNY469oYMSDba9nuGHsiec Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: f673fd6851904ccbb5a916a8bdea0ab9 Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-948611144 Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:25:36.962549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f673fd6851904ccbb5a916a8bdea0ab9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f673fd6851904ccbb5a916a8bdea0ab9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f673fd6851904ccbb5a916a8bdea0ab9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f673fd6851904ccbb5a916a8bdea0ab9"}]}] Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-948611144 Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: f673fd6851904ccbb5a916a8bdea0ab9 Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-948611144 Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotsTestJSON-948611144-project Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: a1bb3995aade4889b7aba475f1d6d1d3 Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-948611144-project Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Snapshot 696bea77-b93c-4761-9276-7722bbbbb722 could not be found. Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '696bea77-b93c-4761-9276-7722bbbbb722'} Aug 08 02:25:36.963887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 696bea77-b93c-4761-9276-7722bbbbb722 could not be found. (HTTP 404) (Request-ID: req-b919916b-5e01-4082-b1de-6272094bb439) Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:36.964642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:25:36.965577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 696bea77-b93c-4761-9276-7722bbbbb722 could not be found. Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 08 02:25:36.968001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:25:36.969296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 696bea77-b93c-4761-9276-7722bbbbb722 could not be found. Aug 08 02:25:36.969296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:36.969296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:36.969296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:36.969296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:36.969296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:36.969296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:36.969296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:25:36.969296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:25:36.969296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 696bea77-b93c-4761-9276-7722bbbbb722 could not be found. Aug 08 02:25:36.969296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:36.970903 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4b2432b3-a528-4aba-bc8e-9df4f28058c7 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Returning 404 to user: Snapshot 696bea77-b93c-4761-9276-7722bbbbb722 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:25:36.972046 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4b2432b3-a528-4aba-bc8e-9df4f28058c7 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722" status: 404 len: 111 microversion: 2.1 time: 0.098366 Aug 08 02:25:36.973654 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 16/31] 10.222.0.39 () {58 vars in 1251 bytes} [Mon Aug 8 02:25:36 2022] GET /compute/v2.1/os-snapshots/696bea77-b93c-4761-9276-7722bbbbb722 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:25:36.986241 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-085ca4dd-1ab0-4862-a2f8-8211daef78e4 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32977e3af0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:37.180305 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-085ca4dd-1ab0-4862-a2f8-8211daef78e4 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922" status: 202 len: 0 microversion: 2.1 time: 0.202357 Aug 08 02:25:37.182193 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 16/32] 10.222.0.39 () {58 vars in 1248 bytes} [Mon Aug 8 02:25:36 2022] DELETE /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:25:37.190599 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-28718dc2-61c8-4c39-ba0a-08180c9b42e8 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f3296f8e8b0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:37.348754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-28718dc2-61c8-4c39-ba0a-08180c9b42e8 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922" status: 200 len: 345 microversion: 2.1 time: 0.162297 Aug 08 02:25:37.349850 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 17/33] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:37 2022] GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922 => generated 345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:25:38.365065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d128853b-4829-4b9f-a78b-69c4bd8fb2d2 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f329780d8b0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:38.427321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-d128853b-4829-4b9f-a78b-69c4bd8fb2d2 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] HTTP exception thrown: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d128853b-4829-4b9f-a78b-69c4bd8fb2d2 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Request method failure captured: Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922 HTTP/1.1 Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQSgKUmEflhEyNIJmCxeG-ETrk5DqO6W8zbdXJ0hkrrYdLFAYm3CwOLaH1_R757B1cA5ivQPkuwhw8kq8yr1P8i_dI2CI4IzjMlDqYtudWCXpZ84zQZ5_E_ueWrPRfgTjMaemQ5G48Vf55EHmOTAgWl0aNY469oYMSDba9nuGHsiec Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: f673fd6851904ccbb5a916a8bdea0ab9 Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-948611144 Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:25:38.429576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f673fd6851904ccbb5a916a8bdea0ab9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f673fd6851904ccbb5a916a8bdea0ab9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f673fd6851904ccbb5a916a8bdea0ab9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f673fd6851904ccbb5a916a8bdea0ab9"}]}] Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-VolumesSnapshotsTestJSON-948611144 Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: f673fd6851904ccbb5a916a8bdea0ab9 Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-948611144 Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-VolumesSnapshotsTestJSON-948611144-project Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: a1bb3995aade4889b7aba475f1d6d1d3 Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-VolumesSnapshotsTestJSON-948611144-project Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': 'df9f4d37-9811-4cd4-9a1c-6830ed5b0922'} Aug 08 02:25:38.431221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. (HTTP 404) (Request-ID: req-c72d22d9-3e83-4bd3-949b-7f4d74f46ee2) Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:38.432636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:25:38.433776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 02:25:38.434874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:25:38.436011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.436011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.436011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:38.436011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.436011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:38.436011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:38.436011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:38.436011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:25:38.436011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:25:38.436011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.436011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.436011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d128853b-4829-4b9f-a78b-69c4bd8fb2d2 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Returning 404 to user: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:25:38.437664 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d128853b-4829-4b9f-a78b-69c4bd8fb2d2 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922" status: 404 len: 109 microversion: 2.1 time: 0.074590 Aug 08 02:25:38.438196 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 17/34] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:38 2022] GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:25:38.455339 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8a3c121f-60f5-4522-bf9a-9042530e29fb tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f3296f8e3a0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:38.535044 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-8a3c121f-60f5-4522-bf9a-9042530e29fb tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] HTTP exception thrown: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8a3c121f-60f5-4522-bf9a-9042530e29fb tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Request method failure captured: Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922 HTTP/1.1 Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQSgKUmEflhEyNIJmCxeG-ETrk5DqO6W8zbdXJ0hkrrYdLFAYm3CwOLaH1_R757B1cA5ivQPkuwhw8kq8yr1P8i_dI2CI4IzjMlDqYtudWCXpZ84zQZ5_E_ueWrPRfgTjMaemQ5G48Vf55EHmOTAgWl0aNY469oYMSDba9nuGHsiec Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: f673fd6851904ccbb5a916a8bdea0ab9 Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-948611144 Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:25:38.539505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f673fd6851904ccbb5a916a8bdea0ab9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f673fd6851904ccbb5a916a8bdea0ab9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f673fd6851904ccbb5a916a8bdea0ab9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f673fd6851904ccbb5a916a8bdea0ab9"}]}] Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-948611144 Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: f673fd6851904ccbb5a916a8bdea0ab9 Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-948611144 Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotsTestJSON-948611144-project Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: a1bb3995aade4889b7aba475f1d6d1d3 Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-948611144-project Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': 'df9f4d37-9811-4cd4-9a1c-6830ed5b0922'} Aug 08 02:25:38.542027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. (HTTP 404) (Request-ID: req-e1aa6932-1b98-4df7-88e1-b13559137d8e) Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:38.543384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 02:25:38.545206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 02:25:38.546484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:25:38.547491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.547491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.547491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:38.547491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.547491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:38.547491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:38.547491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:38.547491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:25:38.547491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:25:38.547491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.547491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.551034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8a3c121f-60f5-4522-bf9a-9042530e29fb tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Returning 404 to user: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:25:38.554934 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8a3c121f-60f5-4522-bf9a-9042530e29fb tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922" status: 404 len: 109 microversion: 2.1 time: 0.101536 Aug 08 02:25:38.555778 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 18/35] 10.222.0.39 () {58 vars in 1248 bytes} [Mon Aug 8 02:25:38 2022] DELETE /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:25:38.566047 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4740efaa-f1e6-4770-9bf1-3e00c97fc676 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Calling method '.version_select at 0x7f32978a7c10>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:38.672356 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-4740efaa-f1e6-4770-9bf1-3e00c97fc676 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] HTTP exception thrown: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4740efaa-f1e6-4770-9bf1-3e00c97fc676 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Request method failure captured: Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922 HTTP/1.1 Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQSgKUmEflhEyNIJmCxeG-ETrk5DqO6W8zbdXJ0hkrrYdLFAYm3CwOLaH1_R757B1cA5ivQPkuwhw8kq8yr1P8i_dI2CI4IzjMlDqYtudWCXpZ84zQZ5_E_ueWrPRfgTjMaemQ5G48Vf55EHmOTAgWl0aNY469oYMSDba9nuGHsiec Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: f673fd6851904ccbb5a916a8bdea0ab9 Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-948611144 Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:25:38.674721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f673fd6851904ccbb5a916a8bdea0ab9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f673fd6851904ccbb5a916a8bdea0ab9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f673fd6851904ccbb5a916a8bdea0ab9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f673fd6851904ccbb5a916a8bdea0ab9"}]}] Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-VolumesSnapshotsTestJSON-948611144 Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: f673fd6851904ccbb5a916a8bdea0ab9 Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-948611144 Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-VolumesSnapshotsTestJSON-948611144-project Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: a1bb3995aade4889b7aba475f1d6d1d3 Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-VolumesSnapshotsTestJSON-948611144-project Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': 'df9f4d37-9811-4cd4-9a1c-6830ed5b0922'} Aug 08 02:25:38.675826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. (HTTP 404) (Request-ID: req-4abf20d2-7e31-4425-8b67-03038efd5374) Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:38.676527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:25:38.677551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 02:25:38.678521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:25:38.679459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.679459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.679459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:38.679459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.679459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:38.679459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:38.679459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:38.679459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:25:38.679459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:25:38.679459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. Aug 08 02:25:38.679459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:38.680633 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4740efaa-f1e6-4770-9bf1-3e00c97fc676 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] Returning 404 to user: Volume df9f4d37-9811-4cd4-9a1c-6830ed5b0922 could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:25:38.681589 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4740efaa-f1e6-4770-9bf1-3e00c97fc676 tempest-VolumesSnapshotsTestJSON-948611144 tempest-VolumesSnapshotsTestJSON-948611144-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922" status: 404 len: 109 microversion: 2.1 time: 0.120543 Aug 08 02:25:38.682310 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 18/36] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:38 2022] GET /compute/v2.1/os-volumes/df9f4d37-9811-4cd4-9a1c-6830ed5b0922 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:25:40.521308 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-245238506", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:40.712663 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] validate_networks() for [('47880f00-89cc-4f2f-a53b-fc4029eccb32', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:25:41.980756 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0a2566cf-36c6-45a8-93d5-93242f2928ca tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Action: 'create', calling method: .version_select at 0x7f329780d310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1944174373", "metadata": {"Type": "work"}}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0a2566cf-36c6-45a8-93d5-93242f2928ca tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Request method failure captured: Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 122 Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQldThAXiuyvzfa6yYWM91TRGhmjmkDfS1X5DNe77BCcgqGhIuCoCX4_9zEuvtcDkPMLe3jKfZQhU8Skpjg0PVBG-hDIrFJfmARCRgqE3UKnY9yHgVxGJBHsQ7qtff2O9r5TBgtYl8UgPyq0FuZrv93tHIfEa2qDtkQQ4aaxPDKkWA Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 7abac19f224a481ea5cae1008061f6b8 Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:25:41.989914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7abac19f224a481ea5cae1008061f6b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7abac19f224a481ea5cae1008061f6b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7abac19f224a481ea5cae1008061f6b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7abac19f224a481ea5cae1008061f6b8"}]}] Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 7abac19f224a481ea5cae1008061f6b8 Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-VolumesNegativeTest-1871432514-project Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 883d1b23657f4c22a7d34ffdda49215f Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-VolumesNegativeTest-1871432514-project Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1944174373", "metadata": {"Type": "work"}}} Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: Aug 08 02:25:41.991137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1944174373', 'metadata': {'Type': 'work'}}}} Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise error Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi '#$%' Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:25:41.991910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 02:25:41.993010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 02:25:41.993931 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 02:25:41.993931 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:41.996970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0a2566cf-36c6-45a8-93d5-93242f2928ca tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:25:41.998162 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0a2566cf-36c6-45a8-93d5-93242f2928ca tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.253918 Aug 08 02:25:42.004232 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 19/37] 10.222.0.39 () {60 vars in 1156 bytes} [Mon Aug 8 02:25:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 256 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 02:25:42.029373 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0445ce88-c1d4-4ca7-aec5-0be5e5476e14 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Action: 'create', calling method: .version_select at 0x7f32977e3a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-691308487", "metadata": {"Type": "work"}}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0445ce88-c1d4-4ca7-aec5-0be5e5476e14 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Request method failure captured: Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 119 Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQldThAXiuyvzfa6yYWM91TRGhmjmkDfS1X5DNe77BCcgqGhIuCoCX4_9zEuvtcDkPMLe3jKfZQhU8Skpjg0PVBG-hDIrFJfmARCRgqE3UKnY9yHgVxGJBHsQ7qtff2O9r5TBgtYl8UgPyq0FuZrv93tHIfEa2qDtkQQ4aaxPDKkWA Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 7abac19f224a481ea5cae1008061f6b8 Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:25:42.033363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7abac19f224a481ea5cae1008061f6b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7abac19f224a481ea5cae1008061f6b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7abac19f224a481ea5cae1008061f6b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7abac19f224a481ea5cae1008061f6b8"}]}] Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 7abac19f224a481ea5cae1008061f6b8 Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-VolumesNegativeTest-1871432514-project Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 883d1b23657f4c22a7d34ffdda49215f Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-VolumesNegativeTest-1871432514-project Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-691308487", "metadata": {"Type": "work"}}} Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: Aug 08 02:25:42.034500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-691308487', 'metadata': {'Type': 'work'}}}} Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise error Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi '0' Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:25:42.035119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 02:25:42.036163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 02:25:42.037135 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 02:25:42.037135 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.037135 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0445ce88-c1d4-4ca7-aec5-0be5e5476e14 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:25:42.037135 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0445ce88-c1d4-4ca7-aec5-0be5e5476e14 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017545 Aug 08 02:25:42.043757 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 20/38] 10.222.0.39 () {60 vars in 1156 bytes} [Mon Aug 8 02:25:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:25:42.049387 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-46596466-8996-41a3-aed6-100cd4df58b9 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Action: 'create', calling method: .version_select at 0x7f32978a79d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1032088675", "metadata": {"Type": "work"}}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-46596466-8996-41a3-aed6-100cd4df58b9 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Request method failure captured: Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 119 Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQldThAXiuyvzfa6yYWM91TRGhmjmkDfS1X5DNe77BCcgqGhIuCoCX4_9zEuvtcDkPMLe3jKfZQhU8Skpjg0PVBG-hDIrFJfmARCRgqE3UKnY9yHgVxGJBHsQ7qtff2O9r5TBgtYl8UgPyq0FuZrv93tHIfEa2qDtkQQ4aaxPDKkWA Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 7abac19f224a481ea5cae1008061f6b8 Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:25:42.055349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7abac19f224a481ea5cae1008061f6b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7abac19f224a481ea5cae1008061f6b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7abac19f224a481ea5cae1008061f6b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7abac19f224a481ea5cae1008061f6b8"}]}] Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 7abac19f224a481ea5cae1008061f6b8 Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-VolumesNegativeTest-1871432514-project Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 883d1b23657f4c22a7d34ffdda49215f Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-VolumesNegativeTest-1871432514-project Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1032088675", "metadata": {"Type": "work"}}} Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: Aug 08 02:25:42.056530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1032088675', 'metadata': {'Type': 'work'}}}} Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise error Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi '' Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:25:42.057912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 02:25:42.068980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 02:25:42.070286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 02:25:42.070286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.070286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-46596466-8996-41a3-aed6-100cd4df58b9 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:25:42.070286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-46596466-8996-41a3-aed6-100cd4df58b9 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014698 Aug 08 02:25:42.070286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 21/39] 10.222.0.39 () {60 vars in 1156 bytes} [Mon Aug 8 02:25:42 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:25:42.077897 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fe6f22ce-396c-4700-9464-09fd55887854 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Calling method '.version_select at 0x7f3296fa5f70>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:42.121160 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-fe6f22ce-396c-4700-9464-09fd55887854 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] HTTP exception thrown: Volume tempest-invalid-522169523 could not be found. Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fe6f22ce-396c-4700-9464-09fd55887854 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Request method failure captured: Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-522169523 HTTP/1.1 Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQldThAXiuyvzfa6yYWM91TRGhmjmkDfS1X5DNe77BCcgqGhIuCoCX4_9zEuvtcDkPMLe3jKfZQhU8Skpjg0PVBG-hDIrFJfmARCRgqE3UKnY9yHgVxGJBHsQ7qtff2O9r5TBgtYl8UgPyq0FuZrv93tHIfEa2qDtkQQ4aaxPDKkWA Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 7abac19f224a481ea5cae1008061f6b8 Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:25:42.128256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7abac19f224a481ea5cae1008061f6b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7abac19f224a481ea5cae1008061f6b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7abac19f224a481ea5cae1008061f6b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7abac19f224a481ea5cae1008061f6b8"}]}] Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 7abac19f224a481ea5cae1008061f6b8 Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-VolumesNegativeTest-1871432514-project Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 883d1b23657f4c22a7d34ffdda49215f Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-VolumesNegativeTest-1871432514-project Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Volume tempest-invalid-522169523 could not be found. Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': 'tempest-invalid-522169523'} Aug 08 02:25:42.129522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-522169523 could not be found. (HTTP 404) (Request-ID: req-11f1e2c7-11ad-4bee-8961-aec065f97ef5) Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.130237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 02:25:42.131271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-522169523 could not be found. Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:25:42.132268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-522169523 could not be found. Aug 08 02:25:42.133292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.133292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.133292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.133292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.133292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:42.133292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:42.133292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:25:42.133292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:25:42.133292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-522169523 could not be found. Aug 08 02:25:42.133292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.137107 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fe6f22ce-396c-4700-9464-09fd55887854 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Returning 404 to user: Volume tempest-invalid-522169523 could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:25:42.140581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fe6f22ce-396c-4700-9464-09fd55887854 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-522169523" status: 404 len: 98 microversion: 2.1 time: 0.067398 Aug 08 02:25:42.141771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 22/40] 10.222.0.39 () {58 vars in 1215 bytes} [Mon Aug 8 02:25:42 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-522169523 => generated 98 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 08 02:25:42.153157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-08ac71af-005c-4176-ac4a-a87a11f7c9d5 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004541 Aug 08 02:25:42.155474 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 23/41] 10.222.0.39 () {58 vars in 1140 bytes} [Mon Aug 8 02:25:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 02:25:42.177903 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9a87185e-5154-496d-92c7-55eb16b9a657 tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011672 Aug 08 02:25:42.181510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 24/42] 10.222.0.39 () {58 vars in 1137 bytes} [Mon Aug 8 02:25:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 02:25:42.193685 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-78f14225-5c92-4ff6-8135-e409bbfab56b tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Calling method '.version_select at 0x7f329780d280>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:42.278128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-78f14225-5c92-4ff6-8135-e409bbfab56b tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] HTTP exception thrown: Volume 6661d6f2-3bf4-480a-a292-27dcf78164ad could not be found. Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-78f14225-5c92-4ff6-8135-e409bbfab56b tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Request method failure captured: Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: DELETE /compute/v2.1/os-volumes/6661d6f2-3bf4-480a-a292-27dcf78164ad HTTP/1.1 Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQldThAXiuyvzfa6yYWM91TRGhmjmkDfS1X5DNe77BCcgqGhIuCoCX4_9zEuvtcDkPMLe3jKfZQhU8Skpjg0PVBG-hDIrFJfmARCRgqE3UKnY9yHgVxGJBHsQ7qtff2O9r5TBgtYl8UgPyq0FuZrv93tHIfEa2qDtkQQ4aaxPDKkWA Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 7abac19f224a481ea5cae1008061f6b8 Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:25:42.280274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7abac19f224a481ea5cae1008061f6b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7abac19f224a481ea5cae1008061f6b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7abac19f224a481ea5cae1008061f6b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7abac19f224a481ea5cae1008061f6b8"}]}] Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 7abac19f224a481ea5cae1008061f6b8 Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-VolumesNegativeTest-1871432514-project Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 883d1b23657f4c22a7d34ffdda49215f Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-VolumesNegativeTest-1871432514-project Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Volume 6661d6f2-3bf4-480a-a292-27dcf78164ad could not be found. Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '6661d6f2-3bf4-480a-a292-27dcf78164ad'} Aug 08 02:25:42.281546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6661d6f2-3bf4-480a-a292-27dcf78164ad could not be found. (HTTP 404) (Request-ID: req-4f60149c-53bf-4726-8de6-512b58f6fd13) Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.282230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 02:25:42.283415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6661d6f2-3bf4-480a-a292-27dcf78164ad could not be found. Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 02:25:42.284510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6661d6f2-3bf4-480a-a292-27dcf78164ad could not be found. Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6661d6f2-3bf4-480a-a292-27dcf78164ad could not be found. Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-78f14225-5c92-4ff6-8135-e409bbfab56b tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Returning 404 to user: Volume 6661d6f2-3bf4-480a-a292-27dcf78164ad could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-78f14225-5c92-4ff6-8135-e409bbfab56b tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/6661d6f2-3bf4-480a-a292-27dcf78164ad" status: 404 len: 109 microversion: 2.1 time: 0.094675 Aug 08 02:25:42.287673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 25/43] 10.222.0.39 () {58 vars in 1248 bytes} [Mon Aug 8 02:25:42 2022] DELETE /compute/v2.1/os-volumes/6661d6f2-3bf4-480a-a292-27dcf78164ad => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:25:42.293663 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7a48f18d-71cb-44d4-a72e-6dc726002afe tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Calling method '.version_select at 0x7f3296fa55e0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:42.362303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-7a48f18d-71cb-44d4-a72e-6dc726002afe tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] HTTP exception thrown: Volume 6ca7a499-e856-49e0-ba97-ac53ee1edf8e could not be found. Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7a48f18d-71cb-44d4-a72e-6dc726002afe tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Request method failure captured: Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/os-volumes/6ca7a499-e856-49e0-ba97-ac53ee1edf8e HTTP/1.1 Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQldThAXiuyvzfa6yYWM91TRGhmjmkDfS1X5DNe77BCcgqGhIuCoCX4_9zEuvtcDkPMLe3jKfZQhU8Skpjg0PVBG-hDIrFJfmARCRgqE3UKnY9yHgVxGJBHsQ7qtff2O9r5TBgtYl8UgPyq0FuZrv93tHIfEa2qDtkQQ4aaxPDKkWA Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 7abac19f224a481ea5cae1008061f6b8 Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:25:42.364316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7abac19f224a481ea5cae1008061f6b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7abac19f224a481ea5cae1008061f6b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7abac19f224a481ea5cae1008061f6b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7abac19f224a481ea5cae1008061f6b8"}]}] Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 7abac19f224a481ea5cae1008061f6b8 Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-VolumesNegativeTest-1871432514 Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-VolumesNegativeTest-1871432514-project Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 883d1b23657f4c22a7d34ffdda49215f Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-VolumesNegativeTest-1871432514-project Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Volume 6ca7a499-e856-49e0-ba97-ac53ee1edf8e could not be found. Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '6ca7a499-e856-49e0-ba97-ac53ee1edf8e'} Aug 08 02:25:42.365661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ca7a499-e856-49e0-ba97-ac53ee1edf8e could not be found. (HTTP 404) (Request-ID: req-84cb245f-c4dc-4bf9-97bc-b83486586871) Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.366694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 02:25:42.368054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ca7a499-e856-49e0-ba97-ac53ee1edf8e could not be found. Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 02:25:42.371113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ca7a499-e856-49e0-ba97-ac53ee1edf8e could not be found. Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ca7a499-e856-49e0-ba97-ac53ee1edf8e could not be found. Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7a48f18d-71cb-44d4-a72e-6dc726002afe tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] Returning 404 to user: Volume 6ca7a499-e856-49e0-ba97-ac53ee1edf8e could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:25:42.372425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7a48f18d-71cb-44d4-a72e-6dc726002afe tempest-VolumesNegativeTest-1871432514 tempest-VolumesNegativeTest-1871432514-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/6ca7a499-e856-49e0-ba97-ac53ee1edf8e" status: 404 len: 109 microversion: 2.1 time: 0.076490 Aug 08 02:25:42.375746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 26/44] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:25:42 2022] GET /compute/v2.1/os-volumes/6ca7a499-e856-49e0-ba97-ac53ee1edf8e => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:25:43.173507 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:25:43.173986 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:25:43.174649 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:25:43.175204 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:25:43.175840 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:25:43.191218 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:43.191920 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:43.195307 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:43.196391 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:43.210965 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:43.212748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:43.282593 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Getting quotas for project 12bf9f0d74de4a57918b688a6d969b28. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:25:43.287412 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Getting quotas for user 1fd1b40cbd884915bdfac150f9718e32 and project 12bf9f0d74de4a57918b688a6d969b28. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:25:43.317962 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:25:43.321005 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:25:43.490377 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-250d5232-89d9-4c32-848e-48bc69111fa8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.360802 Aug 08 02:25:43.491563 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 19/45] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:25:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 3363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:25:43.504759 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-677d6679-e9a8-428b-b280-0ddf3fc640ed tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:43.507296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-677d6679-e9a8-428b-b280-0ddf3fc640ed tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:44.359685 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-677d6679-e9a8-428b-b280-0ddf3fc640ed tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:44.389116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-677d6679-e9a8-428b-b280-0ddf3fc640ed tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1221 microversion: 2.1 time: 0.889483 Aug 08 02:25:44.390576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 27/46] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:43 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1221 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:44.684780 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1746244485", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:44.831289 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] validate_networks() for [('47880f00-89cc-4f2f-a53b-fc4029eccb32', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:25:45.191078 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-400071750", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a62e92c-7187-4f0e-842d-c113cd8a0af1"}], "security_groups": [{"name": "tempest-securitygroup--422679263"}], "key_name": "tempest-keypair-1385408535", "user_data": "}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:45.841972 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.network.neutron [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] validate_networks() for [('2a62e92c-7187-4f0e-842d-c113cd8a0af1', None, None, None, None, None)] {{(pid=117640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:25:46.126040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:25:46.127202 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:25:46.128080 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:25:46.128799 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:25:46.129411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:25:46.149380 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:46.152707 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:46.153519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:46.154593 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:46.155224 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:46.157064 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:46.206843 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Getting quotas for project 12bf9f0d74de4a57918b688a6d969b28. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:25:46.213963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Getting quotas for user 1fd1b40cbd884915bdfac150f9718e32 and project 12bf9f0d74de4a57918b688a6d969b28. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:25:46.246049 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:25:46.249302 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:25:46.319750 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-861927af-9f51-42f2-8d98-3dfde2cd6006 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.640083 Aug 08 02:25:46.321452 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 20/47] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:25:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 02:25:46.341655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-257411797", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fc76955-f5da-4c01-89b2-1843ac68f2ac"}], "security_groups": [{"name": "tempest-securitygroup--909681714"}], "key_name": "tempest-keypair-1725379006", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:46.667978 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] validate_networks() for [('3fc76955-f5da-4c01-89b2-1843ac68f2ac', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:25:48.114797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:25:48.116043 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:25:48.116748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:25:48.117885 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:25:48.118654 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:25:48.137967 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:48.140735 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:48.141337 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:48.142314 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:48.143635 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:48.145615 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:48.199272 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Getting quotas for project 9ae7098cc9f24d9dbc4695789c5b87b4. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:25:48.215800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Getting quotas for user 17286ff2e1764ec7b91e6274c7162437 and project 9ae7098cc9f24d9dbc4695789c5b87b4. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:25:48.253745 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:25:48.260012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:25:48.360294 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0bff520b-e5dc-412d-aaf2-52f5f19e3c0c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.037359 Aug 08 02:25:48.361827 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 21/48] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:25:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 2039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:25:48.368000 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a5be0cbc-b46f-4084-9c2a-01bfe6d9987d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:48.370236 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a5be0cbc-b46f-4084-9c2a-01bfe6d9987d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:48.386601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5be0cbc-b46f-4084-9c2a-01bfe6d9987d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:48.387323 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5be0cbc-b46f-4084-9c2a-01bfe6d9987d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:48.387935 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5be0cbc-b46f-4084-9c2a-01bfe6d9987d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:48.388826 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5be0cbc-b46f-4084-9c2a-01bfe6d9987d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:48.389429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5be0cbc-b46f-4084-9c2a-01bfe6d9987d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:48.390335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5be0cbc-b46f-4084-9c2a-01bfe6d9987d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:48.945623 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a5be0cbc-b46f-4084-9c2a-01bfe6d9987d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:48.995212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a5be0cbc-b46f-4084-9c2a-01bfe6d9987d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1274 microversion: 2.1 time: 0.631454 Aug 08 02:25:48.995759 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 22/49] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:48 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1274 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:49.499817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Flavor limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:25:49.500321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Image limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:25:49.501011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Flavor pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:25:49.501442 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Image pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:25:49.501863 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:25:49.521018 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:49.523838 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:49.524597 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:49.529225 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:49.531286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:49.532147 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:49.621233 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:25:49.631688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for user 43dd72b161f8442285dea411741d66b3 and project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:25:49.673669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Going to run 1 instances... {{(pid=117640) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:25:49.687802 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:25:49.841541 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-328372822", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "networks": [{"uuid": "4522ff28-5883-4ba7-a643-7c62816c7544"}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:50.034587 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] validate_networks() for [('4522ff28-5883-4ba7-a643-7c62816c7544', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:25:50.044571 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-67315bbc-7991-4bf7-b4bb-8fa5f7567d49 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.859794 Aug 08 02:25:50.054778 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 28/50] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:25:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 4865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 02:25:50.060884 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ad7e6d4c-ee52-4fe2-9724-7c05a9622e91 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:50.061520 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ad7e6d4c-ee52-4fe2-9724-7c05a9622e91 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:50.103197 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ad7e6d4c-ee52-4fe2-9724-7c05a9622e91 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:50.103757 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ad7e6d4c-ee52-4fe2-9724-7c05a9622e91 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:50.104176 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ad7e6d4c-ee52-4fe2-9724-7c05a9622e91 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:50.104889 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ad7e6d4c-ee52-4fe2-9724-7c05a9622e91 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:50.105340 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ad7e6d4c-ee52-4fe2-9724-7c05a9622e91 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:50.105760 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ad7e6d4c-ee52-4fe2-9724-7c05a9622e91 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:51.022366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ad7e6d4c-ee52-4fe2-9724-7c05a9622e91 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:51.066014 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ad7e6d4c-ee52-4fe2-9724-7c05a9622e91 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1289 microversion: 2.1 time: 1.014681 Aug 08 02:25:51.080492 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 29/51] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:50 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1289 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:51.080492 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-861140b0-f082-4dc7-b34f-96964e71023a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:51.080492 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-861140b0-f082-4dc7-b34f-96964e71023a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:51.106066 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-861140b0-f082-4dc7-b34f-96964e71023a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:51.111933 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-861140b0-f082-4dc7-b34f-96964e71023a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:51.113412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-861140b0-f082-4dc7-b34f-96964e71023a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:51.115094 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-861140b0-f082-4dc7-b34f-96964e71023a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:51.116525 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-861140b0-f082-4dc7-b34f-96964e71023a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:51.118779 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-861140b0-f082-4dc7-b34f-96964e71023a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:51.935481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-861140b0-f082-4dc7-b34f-96964e71023a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:51.947912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-861140b0-f082-4dc7-b34f-96964e71023a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1280 microversion: 2.1 time: 0.879127 Aug 08 02:25:51.949716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 30/52] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:51 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1280 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:51.970869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-01ef6996-7faf-4b99-80b4-41e55b7e4a52 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:51.972545 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-01ef6996-7faf-4b99-80b4-41e55b7e4a52 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:51.993023 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01ef6996-7faf-4b99-80b4-41e55b7e4a52 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:51.993761 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01ef6996-7faf-4b99-80b4-41e55b7e4a52 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:51.995747 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01ef6996-7faf-4b99-80b4-41e55b7e4a52 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:51.998437 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01ef6996-7faf-4b99-80b4-41e55b7e4a52 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:51.998437 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01ef6996-7faf-4b99-80b4-41e55b7e4a52 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:51.998437 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01ef6996-7faf-4b99-80b4-41e55b7e4a52 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:52.167126 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:25:52.167868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:25:52.168608 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:25:52.169487 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:25:52.170077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:25:52.200289 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:52.202385 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:52.204380 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:52.207498 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:52.208126 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:52.212475 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:52.284718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Getting quotas for project e84c6c5ce3cd45f48c581553d10fdc10. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:25:52.297207 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Getting quotas for user 3ee31a15cc0a481a85a8d0e161217df4 and project e84c6c5ce3cd45f48c581553d10fdc10. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:25:52.343225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:25:52.353066 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:25:52.410638 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-01ef6996-7faf-4b99-80b4-41e55b7e4a52 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:52.429491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-01ef6996-7faf-4b99-80b4-41e55b7e4a52 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1237 microversion: 2.1 time: 0.477912 Aug 08 02:25:52.438351 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 31/53] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:51 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1237 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:52.499376 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-92949a78-00c5-4b7e-8bed-404bc0b9010a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:52.521185 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-92949a78-00c5-4b7e-8bed-404bc0b9010a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:52.554733 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-19025165-cea3-4843-a540-ca4849bdf17e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.557803 Aug 08 02:25:52.564246 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92949a78-00c5-4b7e-8bed-404bc0b9010a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:52.564751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92949a78-00c5-4b7e-8bed-404bc0b9010a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:52.565189 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92949a78-00c5-4b7e-8bed-404bc0b9010a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:52.565904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92949a78-00c5-4b7e-8bed-404bc0b9010a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:52.566383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92949a78-00c5-4b7e-8bed-404bc0b9010a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:52.566809 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92949a78-00c5-4b7e-8bed-404bc0b9010a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:52.579557 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 23/54] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:25:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:25:52.599428 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0adc5a3e-9a43-4144-8f4a-0c8a90e68efa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:52.603933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0adc5a3e-9a43-4144-8f4a-0c8a90e68efa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:52.907502 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0adc5a3e-9a43-4144-8f4a-0c8a90e68efa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:52.930737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0adc5a3e-9a43-4144-8f4a-0c8a90e68efa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1214 microversion: 2.1 time: 0.348332 Aug 08 02:25:52.933628 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 24/55] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:52 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1214 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:25:52.974105 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-31f3f9c4-22d0-4ff4-a220-6386f00c882e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:52.979544 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-31f3f9c4-22d0-4ff4-a220-6386f00c882e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:52.991943 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31f3f9c4-22d0-4ff4-a220-6386f00c882e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:53.000504 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31f3f9c4-22d0-4ff4-a220-6386f00c882e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:53.007138 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31f3f9c4-22d0-4ff4-a220-6386f00c882e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:53.016784 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31f3f9c4-22d0-4ff4-a220-6386f00c882e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:53.017509 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31f3f9c4-22d0-4ff4-a220-6386f00c882e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:53.020261 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-31f3f9c4-22d0-4ff4-a220-6386f00c882e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:54.140215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-92949a78-00c5-4b7e-8bed-404bc0b9010a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:54.149035 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-92949a78-00c5-4b7e-8bed-404bc0b9010a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1295 microversion: 2.1 time: 1.705951 Aug 08 02:25:54.161891 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 32/56] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:52 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1295 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:54.211629 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0d960a2a-7b9c-43f1-a626-12c18847f3ff tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:54.212196 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0d960a2a-7b9c-43f1-a626-12c18847f3ff tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:54.239474 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0d960a2a-7b9c-43f1-a626-12c18847f3ff tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:54.239999 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0d960a2a-7b9c-43f1-a626-12c18847f3ff tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:54.249808 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0d960a2a-7b9c-43f1-a626-12c18847f3ff tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:54.251576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0d960a2a-7b9c-43f1-a626-12c18847f3ff tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:54.257056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0d960a2a-7b9c-43f1-a626-12c18847f3ff tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:54.257512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0d960a2a-7b9c-43f1-a626-12c18847f3ff tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:54.616382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-31f3f9c4-22d0-4ff4-a220-6386f00c882e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:54.645800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-31f3f9c4-22d0-4ff4-a220-6386f00c882e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 1.676055 Aug 08 02:25:54.647090 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 25/57] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:52 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:54.663496 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3dad6bbb-2c9a-4422-9746-82ba7d4651e7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:54.664395 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3dad6bbb-2c9a-4422-9746-82ba7d4651e7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:54.691844 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dad6bbb-2c9a-4422-9746-82ba7d4651e7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:54.693808 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dad6bbb-2c9a-4422-9746-82ba7d4651e7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:54.694484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dad6bbb-2c9a-4422-9746-82ba7d4651e7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:54.696030 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dad6bbb-2c9a-4422-9746-82ba7d4651e7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:54.698046 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dad6bbb-2c9a-4422-9746-82ba7d4651e7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:54.698771 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3dad6bbb-2c9a-4422-9746-82ba7d4651e7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:54.825531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3dad6bbb-2c9a-4422-9746-82ba7d4651e7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:54.867616 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3dad6bbb-2c9a-4422-9746-82ba7d4651e7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1266 microversion: 2.1 time: 0.217187 Aug 08 02:25:54.871620 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 26/58] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:54 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:55.043259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0d960a2a-7b9c-43f1-a626-12c18847f3ff tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:55.055494 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0d960a2a-7b9c-43f1-a626-12c18847f3ff tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1299 microversion: 2.1 time: 0.888806 Aug 08 02:25:55.059369 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 33/59] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:54 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1299 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:55.176003 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d584708f-6c63-47f0-a93e-a5ca8fac2dad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:55.177100 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d584708f-6c63-47f0-a93e-a5ca8fac2dad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:55.192782 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d584708f-6c63-47f0-a93e-a5ca8fac2dad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:55.195685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d584708f-6c63-47f0-a93e-a5ca8fac2dad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:55.202608 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d584708f-6c63-47f0-a93e-a5ca8fac2dad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:55.207506 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d584708f-6c63-47f0-a93e-a5ca8fac2dad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:55.210998 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d584708f-6c63-47f0-a93e-a5ca8fac2dad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:55.228461 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d584708f-6c63-47f0-a93e-a5ca8fac2dad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:55.671318 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2456cffe-d6eb-4184-af05-7ebec028c2e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:55.672201 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2456cffe-d6eb-4184-af05-7ebec028c2e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:55.693389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2456cffe-d6eb-4184-af05-7ebec028c2e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:55.698755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2456cffe-d6eb-4184-af05-7ebec028c2e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:55.701528 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2456cffe-d6eb-4184-af05-7ebec028c2e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:55.703480 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2456cffe-d6eb-4184-af05-7ebec028c2e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:55.711541 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2456cffe-d6eb-4184-af05-7ebec028c2e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:55.719352 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2456cffe-d6eb-4184-af05-7ebec028c2e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:55.924999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d584708f-6c63-47f0-a93e-a5ca8fac2dad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:55.941863 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d584708f-6c63-47f0-a93e-a5ca8fac2dad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1295 microversion: 2.1 time: 0.771170 Aug 08 02:25:55.944409 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 27/60] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:55 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1295 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:55.963378 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dd34603e-e32b-4239-a441-ff7638751bf7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:55.964883 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dd34603e-e32b-4239-a441-ff7638751bf7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:55.999664 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd34603e-e32b-4239-a441-ff7638751bf7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:56.001449 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd34603e-e32b-4239-a441-ff7638751bf7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:56.003917 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd34603e-e32b-4239-a441-ff7638751bf7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:56.006943 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd34603e-e32b-4239-a441-ff7638751bf7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:56.008956 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd34603e-e32b-4239-a441-ff7638751bf7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:56.016814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd34603e-e32b-4239-a441-ff7638751bf7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:56.568804 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dd34603e-e32b-4239-a441-ff7638751bf7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:56.591848 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dd34603e-e32b-4239-a441-ff7638751bf7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1272 microversion: 2.1 time: 0.644471 Aug 08 02:25:56.595815 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 28/61] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:55 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1272 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:56.611715 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1874703a-726e-475a-b806-6ca0bc523f1e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:56.613054 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1874703a-726e-475a-b806-6ca0bc523f1e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:56.625425 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1874703a-726e-475a-b806-6ca0bc523f1e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:56.626464 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1874703a-726e-475a-b806-6ca0bc523f1e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:56.628153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1874703a-726e-475a-b806-6ca0bc523f1e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:56.629377 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1874703a-726e-475a-b806-6ca0bc523f1e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:56.630168 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1874703a-726e-475a-b806-6ca0bc523f1e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:56.631886 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1874703a-726e-475a-b806-6ca0bc523f1e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:57.168383 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1874703a-726e-475a-b806-6ca0bc523f1e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:57.188457 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1874703a-726e-475a-b806-6ca0bc523f1e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1299 microversion: 2.1 time: 0.586146 Aug 08 02:25:57.191699 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 29/62] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:56 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1299 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:57.210986 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-125fa433-e9e4-4b55-86d9-18a8801b2876 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:57.213326 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-125fa433-e9e4-4b55-86d9-18a8801b2876 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:57.232027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-125fa433-e9e4-4b55-86d9-18a8801b2876 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:57.233231 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-125fa433-e9e4-4b55-86d9-18a8801b2876 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:57.235137 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-125fa433-e9e4-4b55-86d9-18a8801b2876 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:57.242205 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-125fa433-e9e4-4b55-86d9-18a8801b2876 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:57.242205 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-125fa433-e9e4-4b55-86d9-18a8801b2876 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:57.242205 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-125fa433-e9e4-4b55-86d9-18a8801b2876 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:57.245041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2456cffe-d6eb-4184-af05-7ebec028c2e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:57.263551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2456cffe-d6eb-4184-af05-7ebec028c2e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 1.596669 Aug 08 02:25:57.268512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 34/63] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:55 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:25:57.647153 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-33108031-cfd0-40a2-8945-d74b9e5dbcbf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:57.654863 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-33108031-cfd0-40a2-8945-d74b9e5dbcbf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:57.701376 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-33108031-cfd0-40a2-8945-d74b9e5dbcbf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:57.702974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-33108031-cfd0-40a2-8945-d74b9e5dbcbf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:57.703718 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-33108031-cfd0-40a2-8945-d74b9e5dbcbf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:57.705232 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-33108031-cfd0-40a2-8945-d74b9e5dbcbf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:57.710432 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-33108031-cfd0-40a2-8945-d74b9e5dbcbf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:57.711327 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-33108031-cfd0-40a2-8945-d74b9e5dbcbf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:57.786136 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-125fa433-e9e4-4b55-86d9-18a8801b2876 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:57.796337 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-125fa433-e9e4-4b55-86d9-18a8801b2876 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.602847 Aug 08 02:25:57.799989 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 30/64] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:57 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:58.212649 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-915d36fe-8241-4050-9777-0e447f24017f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:58.213703 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-915d36fe-8241-4050-9777-0e447f24017f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:58.230573 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-915d36fe-8241-4050-9777-0e447f24017f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:58.232497 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-915d36fe-8241-4050-9777-0e447f24017f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:58.234522 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-915d36fe-8241-4050-9777-0e447f24017f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:58.236754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-915d36fe-8241-4050-9777-0e447f24017f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:58.240857 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-915d36fe-8241-4050-9777-0e447f24017f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:58.241495 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-915d36fe-8241-4050-9777-0e447f24017f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:58.298410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-33108031-cfd0-40a2-8945-d74b9e5dbcbf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:58.319982 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-33108031-cfd0-40a2-8945-d74b9e5dbcbf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1272 microversion: 2.1 time: 0.700814 Aug 08 02:25:58.320596 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 35/65] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:57 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1272 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:58.622151 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-537413bd-8f00-4075-a057-72404e176f66 req-dec10913-95a3-40d3-b38e-56ecd2539141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b248f4-c0a5-4bf3-b424-5e953068e4a5", "tag": "9b89e848-9490-437b-b21c-d15edb41b4c4"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:25:58.654609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-537413bd-8f00-4075-a057-72404e176f66 req-dec10913-95a3-40d3-b38e-56ecd2539141 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:58.655411 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-537413bd-8f00-4075-a057-72404e176f66 req-dec10913-95a3-40d3-b38e-56ecd2539141 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:58.656325 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-537413bd-8f00-4075-a057-72404e176f66 req-dec10913-95a3-40d3-b38e-56ecd2539141 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:58.702944 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-915d36fe-8241-4050-9777-0e447f24017f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:58.725672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-537413bd-8f00-4075-a057-72404e176f66 req-dec10913-95a3-40d3-b38e-56ecd2539141 service nova] Creating event network-changed:9b89e848-9490-437b-b21c-d15edb41b4c4 for instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 on hv-cinder-73306 Aug 08 02:25:58.726241 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-537413bd-8f00-4075-a057-72404e176f66 req-dec10913-95a3-40d3-b38e-56ecd2539141 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 02:25:58.727428 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-537413bd-8f00-4075-a057-72404e176f66 req-dec10913-95a3-40d3-b38e-56ecd2539141 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 02:25:58.732408 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54dc53e1-0009-43c0-bdc0-e70529b51b13 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:58.733771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54dc53e1-0009-43c0-bdc0-e70529b51b13 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:58.734233 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54dc53e1-0009-43c0-bdc0-e70529b51b13 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:58.737460 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54dc53e1-0009-43c0-bdc0-e70529b51b13 None None] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:58.739222 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54dc53e1-0009-43c0-bdc0-e70529b51b13 None None] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:58.739352 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-915d36fe-8241-4050-9777-0e447f24017f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1299 microversion: 2.1 time: 0.531612 Aug 08 02:25:58.739953 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54dc53e1-0009-43c0-bdc0-e70529b51b13 None None] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:58.749520 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 31/66] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:58 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1299 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:25:58.751262 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.compute.rpcapi [None req-54dc53e1-0009-43c0-bdc0-e70529b51b13 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 02:25:58.753718 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54dc53e1-0009-43c0-bdc0-e70529b51b13 None None] Releasing lock "compute-rpcapi-router" {{(pid=117640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 02:25:58.767242 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-20a58845-73a5-4e54-95ad-cf19e316f45d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:58.771466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-20a58845-73a5-4e54-95ad-cf19e316f45d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:58.793950 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:58.799480 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20a58845-73a5-4e54-95ad-cf19e316f45d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:58.802866 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20a58845-73a5-4e54-95ad-cf19e316f45d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:58.803310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20a58845-73a5-4e54-95ad-cf19e316f45d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:58.803869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-54dc53e1-0009-43c0-bdc0-e70529b51b13 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.479496 Aug 08 02:25:58.804040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20a58845-73a5-4e54-95ad-cf19e316f45d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:58.804884 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 36/67] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:25:58.808647 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20a58845-73a5-4e54-95ad-cf19e316f45d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:58.810582 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20a58845-73a5-4e54-95ad-cf19e316f45d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:58.823275 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-51abbae5-e67c-4810-b16d-97d099c55ecd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:58.824047 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-51abbae5-e67c-4810-b16d-97d099c55ecd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:58.836742 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-51abbae5-e67c-4810-b16d-97d099c55ecd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:58.841131 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-51abbae5-e67c-4810-b16d-97d099c55ecd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:58.842008 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-51abbae5-e67c-4810-b16d-97d099c55ecd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:58.842912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-51abbae5-e67c-4810-b16d-97d099c55ecd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:58.846358 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-51abbae5-e67c-4810-b16d-97d099c55ecd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:58.846996 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-51abbae5-e67c-4810-b16d-97d099c55ecd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:59.219590 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-51abbae5-e67c-4810-b16d-97d099c55ecd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:59.233311 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-20a58845-73a5-4e54-95ad-cf19e316f45d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:59.243765 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-51abbae5-e67c-4810-b16d-97d099c55ecd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.426369 Aug 08 02:25:59.245116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 37/68] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:58 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:25:59.262163 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-20a58845-73a5-4e54-95ad-cf19e316f45d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.511464 Aug 08 02:25:59.262775 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 32/69] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:58 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:59.345435 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f46a367e-e6df-4458-b391-df937bce8348 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:59.346173 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f46a367e-e6df-4458-b391-df937bce8348 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:59.360055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f46a367e-e6df-4458-b391-df937bce8348 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:59.360842 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f46a367e-e6df-4458-b391-df937bce8348 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:59.361578 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f46a367e-e6df-4458-b391-df937bce8348 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:59.362698 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f46a367e-e6df-4458-b391-df937bce8348 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:59.364721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f46a367e-e6df-4458-b391-df937bce8348 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:59.365373 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f46a367e-e6df-4458-b391-df937bce8348 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:59.652438 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=12 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:25:59.737064 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f46a367e-e6df-4458-b391-df937bce8348 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:25:59.745317 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f46a367e-e6df-4458-b391-df937bce8348 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.404170 Aug 08 02:25:59.745897 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 38/70] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:59 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:25:59.765560 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-14bfe613-1e92-48e8-9116-69117bde0a0e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:25:59.766332 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-14bfe613-1e92-48e8-9116-69117bde0a0e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:25:59.783115 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14bfe613-1e92-48e8-9116-69117bde0a0e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:59.785562 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14bfe613-1e92-48e8-9116-69117bde0a0e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:59.786240 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14bfe613-1e92-48e8-9116-69117bde0a0e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:25:59.787326 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14bfe613-1e92-48e8-9116-69117bde0a0e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:25:59.788180 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14bfe613-1e92-48e8-9116-69117bde0a0e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:25:59.788927 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14bfe613-1e92-48e8-9116-69117bde0a0e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:00.086276 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-14bfe613-1e92-48e8-9116-69117bde0a0e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:00.094768 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-14bfe613-1e92-48e8-9116-69117bde0a0e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.333293 Aug 08 02:26:00.095954 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 33/71] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:25:59 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:00.264694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4db9f270-af31-418d-8717-36f1705c40d3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:00.266283 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4db9f270-af31-418d-8717-36f1705c40d3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:00.275474 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4db9f270-af31-418d-8717-36f1705c40d3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:00.275935 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4db9f270-af31-418d-8717-36f1705c40d3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:00.276415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4db9f270-af31-418d-8717-36f1705c40d3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:00.277467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4db9f270-af31-418d-8717-36f1705c40d3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:00.277918 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4db9f270-af31-418d-8717-36f1705c40d3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:00.279953 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4db9f270-af31-418d-8717-36f1705c40d3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:00.437459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4db9f270-af31-418d-8717-36f1705c40d3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:00.448373 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4db9f270-af31-418d-8717-36f1705c40d3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.187722 Aug 08 02:26:00.448958 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 39/72] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:00 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:00.457722 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-81979375-7267-46ef-a35c-f18f387bfc55 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:00.458675 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-81979375-7267-46ef-a35c-f18f387bfc55 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:00.468645 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-81979375-7267-46ef-a35c-f18f387bfc55 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:00.469021 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-81979375-7267-46ef-a35c-f18f387bfc55 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:00.469633 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-81979375-7267-46ef-a35c-f18f387bfc55 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:00.470692 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-81979375-7267-46ef-a35c-f18f387bfc55 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:00.471150 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-81979375-7267-46ef-a35c-f18f387bfc55 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:00.471580 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-81979375-7267-46ef-a35c-f18f387bfc55 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:00.487904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-38264458-4030-4b73-b790-98a84b680121 req-e1393787-b063-480a-abd1-ac3a4a206bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13364414-05f0-413b-bd7e-27ad8c210e32", "tag": "dbb78041-5c91-4099-9e3f-6221c1a48511"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:00.505945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-38264458-4030-4b73-b790-98a84b680121 req-e1393787-b063-480a-abd1-ac3a4a206bd8 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:00.505945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-38264458-4030-4b73-b790-98a84b680121 req-e1393787-b063-480a-abd1-ac3a4a206bd8 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:00.505945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-38264458-4030-4b73-b790-98a84b680121 req-e1393787-b063-480a-abd1-ac3a4a206bd8 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:00.524629 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-38264458-4030-4b73-b790-98a84b680121 req-e1393787-b063-480a-abd1-ac3a4a206bd8 service nova] Creating event network-changed:dbb78041-5c91-4099-9e3f-6221c1a48511 for instance 13364414-05f0-413b-bd7e-27ad8c210e32 on hv-cinder-73306 Aug 08 02:26:00.525677 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-38264458-4030-4b73-b790-98a84b680121 req-e1393787-b063-480a-abd1-ac3a4a206bd8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 02:26:00.526077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-38264458-4030-4b73-b790-98a84b680121 req-e1393787-b063-480a-abd1-ac3a4a206bd8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 02:26:00.527160 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfe4babf-0703-4898-8fef-ad8143290ae7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:00.527568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfe4babf-0703-4898-8fef-ad8143290ae7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:00.528044 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfe4babf-0703-4898-8fef-ad8143290ae7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:00.528823 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfe4babf-0703-4898-8fef-ad8143290ae7 None None] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:00.529314 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfe4babf-0703-4898-8fef-ad8143290ae7 None None] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:00.529876 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfe4babf-0703-4898-8fef-ad8143290ae7 None None] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:00.539597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.compute.rpcapi [None req-bfe4babf-0703-4898-8fef-ad8143290ae7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 02:26:00.541532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bfe4babf-0703-4898-8fef-ad8143290ae7 None None] Releasing lock "compute-rpcapi-router" {{(pid=117642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 02:26:00.569424 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bfe4babf-0703-4898-8fef-ad8143290ae7 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.306967 Aug 08 02:26:00.570852 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 34/73] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:26:00.669584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-81979375-7267-46ef-a35c-f18f387bfc55 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:00.681896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-81979375-7267-46ef-a35c-f18f387bfc55 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.230070 Aug 08 02:26:00.682715 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 40/74] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:00 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:00.767540 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b82529ac-5c61-4b5e-9319-95077244d1ad tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:00.768257 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b82529ac-5c61-4b5e-9319-95077244d1ad tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:00.774614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b82529ac-5c61-4b5e-9319-95077244d1ad tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:00.775878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b82529ac-5c61-4b5e-9319-95077244d1ad tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:00.776310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b82529ac-5c61-4b5e-9319-95077244d1ad tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:00.777008 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b82529ac-5c61-4b5e-9319-95077244d1ad tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:00.777456 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b82529ac-5c61-4b5e-9319-95077244d1ad tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:00.778038 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b82529ac-5c61-4b5e-9319-95077244d1ad tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:00.934948 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b82529ac-5c61-4b5e-9319-95077244d1ad tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:00.945669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b82529ac-5c61-4b5e-9319-95077244d1ad tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.182685 Aug 08 02:26:00.946446 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 35/75] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:00 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:01.121434 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c7310376-7552-4b13-9232-90a0b834b02a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:01.122305 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c7310376-7552-4b13-9232-90a0b834b02a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:01.129168 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c7310376-7552-4b13-9232-90a0b834b02a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:01.129910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c7310376-7552-4b13-9232-90a0b834b02a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:01.130541 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c7310376-7552-4b13-9232-90a0b834b02a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:01.131595 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c7310376-7552-4b13-9232-90a0b834b02a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:01.132295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c7310376-7552-4b13-9232-90a0b834b02a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:01.132906 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c7310376-7552-4b13-9232-90a0b834b02a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:01.299956 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c7310376-7552-4b13-9232-90a0b834b02a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:01.308444 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c7310376-7552-4b13-9232-90a0b834b02a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.191431 Aug 08 02:26:01.309526 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 41/76] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:01 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:01.470066 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6905d269-176e-4754-8f6c-86199bc38af0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:01.470891 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6905d269-176e-4754-8f6c-86199bc38af0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:01.477544 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6905d269-176e-4754-8f6c-86199bc38af0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:01.478905 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6905d269-176e-4754-8f6c-86199bc38af0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:01.479519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6905d269-176e-4754-8f6c-86199bc38af0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:01.480593 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6905d269-176e-4754-8f6c-86199bc38af0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:01.481300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6905d269-176e-4754-8f6c-86199bc38af0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:01.481981 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6905d269-176e-4754-8f6c-86199bc38af0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:01.702913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6905d269-176e-4754-8f6c-86199bc38af0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:01.703634 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-39730512-e37e-4afa-9997-6139016d8a5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:01.704773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-39730512-e37e-4afa-9997-6139016d8a5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:01.713083 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6905d269-176e-4754-8f6c-86199bc38af0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.246904 Aug 08 02:26:01.713679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 36/77] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:01 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:01.713869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-39730512-e37e-4afa-9997-6139016d8a5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:01.715964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-39730512-e37e-4afa-9997-6139016d8a5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:01.717181 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-39730512-e37e-4afa-9997-6139016d8a5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:01.717888 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-39730512-e37e-4afa-9997-6139016d8a5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:01.718689 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-39730512-e37e-4afa-9997-6139016d8a5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:01.719290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-39730512-e37e-4afa-9997-6139016d8a5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:01.887384 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-39730512-e37e-4afa-9997-6139016d8a5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:01.906186 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-39730512-e37e-4afa-9997-6139016d8a5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.206411 Aug 08 02:26:01.908991 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 42/78] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:01 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:01.967758 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-15f91302-a558-48bb-8b0b-fb22f1a7d079 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:01.968446 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-15f91302-a558-48bb-8b0b-fb22f1a7d079 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:01.977642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15f91302-a558-48bb-8b0b-fb22f1a7d079 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:01.981645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15f91302-a558-48bb-8b0b-fb22f1a7d079 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:01.982261 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15f91302-a558-48bb-8b0b-fb22f1a7d079 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:01.983159 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15f91302-a558-48bb-8b0b-fb22f1a7d079 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:01.983755 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15f91302-a558-48bb-8b0b-fb22f1a7d079 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:01.984327 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15f91302-a558-48bb-8b0b-fb22f1a7d079 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:02.329029 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d2af21fb-13c6-4c10-9357-e1b8599fd61c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:02.329875 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d2af21fb-13c6-4c10-9357-e1b8599fd61c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:02.336139 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2af21fb-13c6-4c10-9357-e1b8599fd61c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:02.336865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2af21fb-13c6-4c10-9357-e1b8599fd61c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:02.337526 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2af21fb-13c6-4c10-9357-e1b8599fd61c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:02.339078 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2af21fb-13c6-4c10-9357-e1b8599fd61c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:02.339682 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2af21fb-13c6-4c10-9357-e1b8599fd61c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:02.340281 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2af21fb-13c6-4c10-9357-e1b8599fd61c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:02.402799 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-15f91302-a558-48bb-8b0b-fb22f1a7d079 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:02.422674 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-15f91302-a558-48bb-8b0b-fb22f1a7d079 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.447770 Aug 08 02:26:02.436419 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 37/79] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:01 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:02.505788 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d2af21fb-13c6-4c10-9357-e1b8599fd61c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:02.514808 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d2af21fb-13c6-4c10-9357-e1b8599fd61c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.189498 Aug 08 02:26:02.515735 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 43/80] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:02 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:02.739250 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-23944560-594d-402a-816b-b9225ed459e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:02.740863 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-23944560-594d-402a-816b-b9225ed459e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:02.749687 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23944560-594d-402a-816b-b9225ed459e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:02.750527 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23944560-594d-402a-816b-b9225ed459e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:02.751124 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23944560-594d-402a-816b-b9225ed459e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:02.752787 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23944560-594d-402a-816b-b9225ed459e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:02.753488 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23944560-594d-402a-816b-b9225ed459e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:02.754053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23944560-594d-402a-816b-b9225ed459e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:02.927425 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:02.937584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f3c3215d-a8b4-459c-a1b4-7b1a5a86f21a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:02.938702 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f3c3215d-a8b4-459c-a1b4-7b1a5a86f21a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:02.957321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f3c3215d-a8b4-459c-a1b4-7b1a5a86f21a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:02.958066 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f3c3215d-a8b4-459c-a1b4-7b1a5a86f21a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:02.958556 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f3c3215d-a8b4-459c-a1b4-7b1a5a86f21a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:02.959482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f3c3215d-a8b4-459c-a1b4-7b1a5a86f21a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:02.960000 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f3c3215d-a8b4-459c-a1b4-7b1a5a86f21a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:02.960744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f3c3215d-a8b4-459c-a1b4-7b1a5a86f21a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:03.080665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-23944560-594d-402a-816b-b9225ed459e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:03.090030 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-23944560-594d-402a-816b-b9225ed459e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.358356 Aug 08 02:26:03.106939 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 38/81] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:02 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:03.244533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f3c3215d-a8b4-459c-a1b4-7b1a5a86f21a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:03.257441 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f3c3215d-a8b4-459c-a1b4-7b1a5a86f21a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.322974 Aug 08 02:26:03.273597 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 44/82] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:02 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:03.443742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a254421-911f-4949-b588-877ba53c053a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:03.444612 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a254421-911f-4949-b588-877ba53c053a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:03.453899 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a254421-911f-4949-b588-877ba53c053a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:03.454435 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a254421-911f-4949-b588-877ba53c053a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:03.454873 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a254421-911f-4949-b588-877ba53c053a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:03.455611 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a254421-911f-4949-b588-877ba53c053a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:03.456340 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a254421-911f-4949-b588-877ba53c053a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:03.456760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a254421-911f-4949-b588-877ba53c053a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:03.494550 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:03.538813 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-15f6ecd9-d118-4a0d-96c1-4856c94a4117 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:03.539439 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-15f6ecd9-d118-4a0d-96c1-4856c94a4117 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:03.551826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-15f6ecd9-d118-4a0d-96c1-4856c94a4117 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:03.552319 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-15f6ecd9-d118-4a0d-96c1-4856c94a4117 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:03.552758 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-15f6ecd9-d118-4a0d-96c1-4856c94a4117 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:03.553463 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-15f6ecd9-d118-4a0d-96c1-4856c94a4117 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:03.554192 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-15f6ecd9-d118-4a0d-96c1-4856c94a4117 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:03.554463 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-15f6ecd9-d118-4a0d-96c1-4856c94a4117 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:03.615181 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:03.779667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a254421-911f-4949-b588-877ba53c053a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:03.788559 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a254421-911f-4949-b588-877ba53c053a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.349198 Aug 08 02:26:03.801971 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 39/83] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:03 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:03.885558 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-15f6ecd9-d118-4a0d-96c1-4856c94a4117 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:03.896360 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-15f6ecd9-d118-4a0d-96c1-4856c94a4117 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.364971 Aug 08 02:26:03.896923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 45/84] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:03 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:04.111741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-588d9072-1e43-4872-ab04-cb54e9f120da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:04.112414 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-588d9072-1e43-4872-ab04-cb54e9f120da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:04.119720 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-588d9072-1e43-4872-ab04-cb54e9f120da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:04.121057 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-588d9072-1e43-4872-ab04-cb54e9f120da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:04.122160 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-588d9072-1e43-4872-ab04-cb54e9f120da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:04.123114 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-588d9072-1e43-4872-ab04-cb54e9f120da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:04.123731 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-588d9072-1e43-4872-ab04-cb54e9f120da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:04.124303 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-588d9072-1e43-4872-ab04-cb54e9f120da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:04.284391 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-35d97679-82b2-431e-a067-e597dfdc88d0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:04.285245 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-35d97679-82b2-431e-a067-e597dfdc88d0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:04.299837 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-35d97679-82b2-431e-a067-e597dfdc88d0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:04.300478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-35d97679-82b2-431e-a067-e597dfdc88d0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:04.302200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-35d97679-82b2-431e-a067-e597dfdc88d0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:04.304531 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-35d97679-82b2-431e-a067-e597dfdc88d0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:04.305088 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-35d97679-82b2-431e-a067-e597dfdc88d0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:04.307532 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-35d97679-82b2-431e-a067-e597dfdc88d0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:04.364450 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-588d9072-1e43-4872-ab04-cb54e9f120da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:04.373553 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-588d9072-1e43-4872-ab04-cb54e9f120da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.265708 Aug 08 02:26:04.387822 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 40/85] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:04 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:04.585145 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-35d97679-82b2-431e-a067-e597dfdc88d0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:04.600151 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-35d97679-82b2-431e-a067-e597dfdc88d0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.316758 Aug 08 02:26:04.601821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 46/86] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:04 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:04.811534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bf78212e-9a2d-4d06-9fb4-d598535c5301 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:04.811534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bf78212e-9a2d-4d06-9fb4-d598535c5301 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:04.819201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf78212e-9a2d-4d06-9fb4-d598535c5301 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:04.819910 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf78212e-9a2d-4d06-9fb4-d598535c5301 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:04.820357 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf78212e-9a2d-4d06-9fb4-d598535c5301 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:04.821154 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf78212e-9a2d-4d06-9fb4-d598535c5301 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:04.821676 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf78212e-9a2d-4d06-9fb4-d598535c5301 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:04.822675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf78212e-9a2d-4d06-9fb4-d598535c5301 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:04.920351 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-10bf0808-bbb4-440c-804f-7ea0af7d94b4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:04.921480 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-10bf0808-bbb4-440c-804f-7ea0af7d94b4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:04.928547 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:04.930458 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10bf0808-bbb4-440c-804f-7ea0af7d94b4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:04.931668 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10bf0808-bbb4-440c-804f-7ea0af7d94b4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:04.932752 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10bf0808-bbb4-440c-804f-7ea0af7d94b4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:04.933854 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10bf0808-bbb4-440c-804f-7ea0af7d94b4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:04.934726 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10bf0808-bbb4-440c-804f-7ea0af7d94b4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:04.935481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10bf0808-bbb4-440c-804f-7ea0af7d94b4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:05.145469 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bf78212e-9a2d-4d06-9fb4-d598535c5301 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:05.161251 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bf78212e-9a2d-4d06-9fb4-d598535c5301 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.355748 Aug 08 02:26:05.167180 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 41/87] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:04 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:05.401579 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c83951e2-95a9-4bdc-b35c-8d2c7a324099 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:05.402430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c83951e2-95a9-4bdc-b35c-8d2c7a324099 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:05.423582 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c83951e2-95a9-4bdc-b35c-8d2c7a324099 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:05.425421 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c83951e2-95a9-4bdc-b35c-8d2c7a324099 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:05.427394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c83951e2-95a9-4bdc-b35c-8d2c7a324099 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:05.430318 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c83951e2-95a9-4bdc-b35c-8d2c7a324099 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:05.434803 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c83951e2-95a9-4bdc-b35c-8d2c7a324099 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:05.435417 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c83951e2-95a9-4bdc-b35c-8d2c7a324099 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:05.922070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c83951e2-95a9-4bdc-b35c-8d2c7a324099 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:05.933198 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c83951e2-95a9-4bdc-b35c-8d2c7a324099 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.537159 Aug 08 02:26:05.935477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 42/88] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:05 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:05.947852 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5a6ec3bf-5e0c-44b3-a22f-5fdaa17ec5fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:05.950121 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5a6ec3bf-5e0c-44b3-a22f-5fdaa17ec5fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:05.961625 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a6ec3bf-5e0c-44b3-a22f-5fdaa17ec5fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:05.962117 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a6ec3bf-5e0c-44b3-a22f-5fdaa17ec5fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:05.963109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a6ec3bf-5e0c-44b3-a22f-5fdaa17ec5fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:05.963811 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a6ec3bf-5e0c-44b3-a22f-5fdaa17ec5fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:05.964260 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a6ec3bf-5e0c-44b3-a22f-5fdaa17ec5fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:05.964677 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a6ec3bf-5e0c-44b3-a22f-5fdaa17ec5fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:06.092197 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-10bf0808-bbb4-440c-804f-7ea0af7d94b4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:06.107538 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-10bf0808-bbb4-440c-804f-7ea0af7d94b4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 1.193754 Aug 08 02:26:06.125168 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 47/89] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:04 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:06.185199 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c399632b-d0a4-4b5a-8f57-28d6149560bc tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:06.186155 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c399632b-d0a4-4b5a-8f57-28d6149560bc tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:06.195077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c399632b-d0a4-4b5a-8f57-28d6149560bc tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:06.195873 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c399632b-d0a4-4b5a-8f57-28d6149560bc tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:06.196974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c399632b-d0a4-4b5a-8f57-28d6149560bc tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:06.198671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c399632b-d0a4-4b5a-8f57-28d6149560bc tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:06.199396 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c399632b-d0a4-4b5a-8f57-28d6149560bc tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:06.200077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c399632b-d0a4-4b5a-8f57-28d6149560bc tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:06.327761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5a6ec3bf-5e0c-44b3-a22f-5fdaa17ec5fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:06.344531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5a6ec3bf-5e0c-44b3-a22f-5fdaa17ec5fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.406980 Aug 08 02:26:06.346010 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 43/90] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:05 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:06.557236 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c399632b-d0a4-4b5a-8f57-28d6149560bc tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:06.576869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c399632b-d0a4-4b5a-8f57-28d6149560bc tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.398232 Aug 08 02:26:06.578270 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 48/91] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:06 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:06.597990 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-23bd1a80-da11-483e-abef-7e67cfac9a6f req-256fc86b-183c-455c-b9b1-dc027ca699b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4568714-ae5a-47eb-9140-be5702dd288e", "tag": "64cd5cbd-515d-4839-a3a7-ee52df20970a"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:06.609806 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-23bd1a80-da11-483e-abef-7e67cfac9a6f req-256fc86b-183c-455c-b9b1-dc027ca699b7 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:06.610531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-23bd1a80-da11-483e-abef-7e67cfac9a6f req-256fc86b-183c-455c-b9b1-dc027ca699b7 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:06.611866 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-23bd1a80-da11-483e-abef-7e67cfac9a6f req-256fc86b-183c-455c-b9b1-dc027ca699b7 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:06.626487 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-23bd1a80-da11-483e-abef-7e67cfac9a6f req-256fc86b-183c-455c-b9b1-dc027ca699b7 service nova] Creating event network-changed:64cd5cbd-515d-4839-a3a7-ee52df20970a for instance b4568714-ae5a-47eb-9140-be5702dd288e on hv-cinder-73306 Aug 08 02:26:06.632905 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-23bd1a80-da11-483e-abef-7e67cfac9a6f req-256fc86b-183c-455c-b9b1-dc027ca699b7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040164 Aug 08 02:26:06.634794 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 44/92] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:06.891471 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-f287de42-009c-4f0f-83c7-333281d259ed req-661159e7-c570-409e-98d5-ad39e3cef446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a61fcac-cea3-4e95-a463-bb2f44b28e39", "tag": "f05f2dd7-1c3e-44dc-8f0b-bf42643bdea5"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:06.901910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-f287de42-009c-4f0f-83c7-333281d259ed req-661159e7-c570-409e-98d5-ad39e3cef446 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:06.902443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-f287de42-009c-4f0f-83c7-333281d259ed req-661159e7-c570-409e-98d5-ad39e3cef446 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:06.902868 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-f287de42-009c-4f0f-83c7-333281d259ed req-661159e7-c570-409e-98d5-ad39e3cef446 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:06.918472 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-f287de42-009c-4f0f-83c7-333281d259ed req-661159e7-c570-409e-98d5-ad39e3cef446 service nova] Creating event network-changed:f05f2dd7-1c3e-44dc-8f0b-bf42643bdea5 for instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 on hv-cinder-73306 Aug 08 02:26:06.924964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-f287de42-009c-4f0f-83c7-333281d259ed req-661159e7-c570-409e-98d5-ad39e3cef446 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036406 Aug 08 02:26:06.926631 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 49/93] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:06.959346 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2a5b0a4b-f8e0-41b6-a147-1a6f0138b0a7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:06.960023 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2a5b0a4b-f8e0-41b6-a147-1a6f0138b0a7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:06.971690 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a5b0a4b-f8e0-41b6-a147-1a6f0138b0a7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:06.972181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a5b0a4b-f8e0-41b6-a147-1a6f0138b0a7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:06.972614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a5b0a4b-f8e0-41b6-a147-1a6f0138b0a7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:06.973308 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a5b0a4b-f8e0-41b6-a147-1a6f0138b0a7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:06.974278 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a5b0a4b-f8e0-41b6-a147-1a6f0138b0a7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:06.974730 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a5b0a4b-f8e0-41b6-a147-1a6f0138b0a7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:07.135744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f3397267-2738-4ecb-a3fe-a672761f86e9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:07.136269 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f3397267-2738-4ecb-a3fe-a672761f86e9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:07.143341 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f3397267-2738-4ecb-a3fe-a672761f86e9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:07.144048 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f3397267-2738-4ecb-a3fe-a672761f86e9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:07.144485 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f3397267-2738-4ecb-a3fe-a672761f86e9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:07.145569 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f3397267-2738-4ecb-a3fe-a672761f86e9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:07.146185 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f3397267-2738-4ecb-a3fe-a672761f86e9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:07.146961 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f3397267-2738-4ecb-a3fe-a672761f86e9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:07.182026 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2a5b0a4b-f8e0-41b6-a147-1a6f0138b0a7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:07.191059 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2a5b0a4b-f8e0-41b6-a147-1a6f0138b0a7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.235451 Aug 08 02:26:07.191991 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 45/94] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:06 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:07.335965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f3397267-2738-4ecb-a3fe-a672761f86e9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:07.344540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f3397267-2738-4ecb-a3fe-a672761f86e9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.213419 Aug 08 02:26:07.345192 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 50/95] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:07 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:07.370016 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5958ad15-c4bf-4a67-a7d6-75752b88287f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:07.370632 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5958ad15-c4bf-4a67-a7d6-75752b88287f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:07.376577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5958ad15-c4bf-4a67-a7d6-75752b88287f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:07.377056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5958ad15-c4bf-4a67-a7d6-75752b88287f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:07.377765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5958ad15-c4bf-4a67-a7d6-75752b88287f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:07.378672 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5958ad15-c4bf-4a67-a7d6-75752b88287f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:07.379122 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5958ad15-c4bf-4a67-a7d6-75752b88287f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:07.379535 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5958ad15-c4bf-4a67-a7d6-75752b88287f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:07.574590 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5958ad15-c4bf-4a67-a7d6-75752b88287f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:07.584398 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5958ad15-c4bf-4a67-a7d6-75752b88287f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.217909 Aug 08 02:26:07.585771 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 46/96] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:07 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:07.607068 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e3ed8c88-9990-49b8-a2e3-6142540c08cd tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:07.607814 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e3ed8c88-9990-49b8-a2e3-6142540c08cd tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:07.616054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e3ed8c88-9990-49b8-a2e3-6142540c08cd tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:07.616771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e3ed8c88-9990-49b8-a2e3-6142540c08cd tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:07.617405 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e3ed8c88-9990-49b8-a2e3-6142540c08cd tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:07.618278 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e3ed8c88-9990-49b8-a2e3-6142540c08cd tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:07.619127 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e3ed8c88-9990-49b8-a2e3-6142540c08cd tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:07.620047 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e3ed8c88-9990-49b8-a2e3-6142540c08cd tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:07.816222 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e3ed8c88-9990-49b8-a2e3-6142540c08cd tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:07.824995 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e3ed8c88-9990-49b8-a2e3-6142540c08cd tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.224073 Aug 08 02:26:07.825956 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 51/97] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:07 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:08.212932 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-841c83f2-5ae7-476d-8b37-b78d9c4a804e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:08.214135 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-841c83f2-5ae7-476d-8b37-b78d9c4a804e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:08.223113 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-841c83f2-5ae7-476d-8b37-b78d9c4a804e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:08.223594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-841c83f2-5ae7-476d-8b37-b78d9c4a804e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:08.224190 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-841c83f2-5ae7-476d-8b37-b78d9c4a804e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:08.224881 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-841c83f2-5ae7-476d-8b37-b78d9c4a804e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:08.225329 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-841c83f2-5ae7-476d-8b37-b78d9c4a804e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:08.225748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-841c83f2-5ae7-476d-8b37-b78d9c4a804e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:08.365495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6fbaf727-f7ca-4929-80ef-053fe11f72a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:08.366213 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6fbaf727-f7ca-4929-80ef-053fe11f72a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:08.376032 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6fbaf727-f7ca-4929-80ef-053fe11f72a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:08.376528 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6fbaf727-f7ca-4929-80ef-053fe11f72a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:08.377003 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6fbaf727-f7ca-4929-80ef-053fe11f72a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:08.378106 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6fbaf727-f7ca-4929-80ef-053fe11f72a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:08.378570 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6fbaf727-f7ca-4929-80ef-053fe11f72a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:08.379221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6fbaf727-f7ca-4929-80ef-053fe11f72a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:08.386483 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-841c83f2-5ae7-476d-8b37-b78d9c4a804e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:08.398487 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-841c83f2-5ae7-476d-8b37-b78d9c4a804e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.190388 Aug 08 02:26:08.399582 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 47/98] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:08 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:08.555393 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6fbaf727-f7ca-4929-80ef-053fe11f72a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:08.563267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6fbaf727-f7ca-4929-80ef-053fe11f72a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.202044 Aug 08 02:26:08.564269 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 52/99] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:08 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:08.607260 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3c0b25bd-d18e-4bfc-b6c1-8cd0fc387e1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:08.607897 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3c0b25bd-d18e-4bfc-b6c1-8cd0fc387e1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:08.614841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c0b25bd-d18e-4bfc-b6c1-8cd0fc387e1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:08.615329 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c0b25bd-d18e-4bfc-b6c1-8cd0fc387e1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:08.615834 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c0b25bd-d18e-4bfc-b6c1-8cd0fc387e1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:08.616731 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c0b25bd-d18e-4bfc-b6c1-8cd0fc387e1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:08.617189 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c0b25bd-d18e-4bfc-b6c1-8cd0fc387e1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:08.617617 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c0b25bd-d18e-4bfc-b6c1-8cd0fc387e1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:08.775725 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3c0b25bd-d18e-4bfc-b6c1-8cd0fc387e1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:08.786718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3c0b25bd-d18e-4bfc-b6c1-8cd0fc387e1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.183797 Aug 08 02:26:08.787286 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 48/100] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:08 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:08.846597 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f18c232e-1b42-4796-816e-3ebb485bc751 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:08.847226 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f18c232e-1b42-4796-816e-3ebb485bc751 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:08.853548 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=4 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:08.855205 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f18c232e-1b42-4796-816e-3ebb485bc751 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:08.855906 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f18c232e-1b42-4796-816e-3ebb485bc751 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:08.856516 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f18c232e-1b42-4796-816e-3ebb485bc751 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:08.857372 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f18c232e-1b42-4796-816e-3ebb485bc751 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:08.857981 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f18c232e-1b42-4796-816e-3ebb485bc751 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:08.858628 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f18c232e-1b42-4796-816e-3ebb485bc751 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:08.944600 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-133a1faa-eccf-4b6f-9be7-aab3179344a4 req-b8c91769-938e-468b-804c-853537b9f95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b990f50-db09-4b89-af90-d4e0d75e0458", "tag": "6f8cd2db-8f57-4877-bbef-d1a00190232b"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:08.964221 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-133a1faa-eccf-4b6f-9be7-aab3179344a4 req-b8c91769-938e-468b-804c-853537b9f95e service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:08.964825 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-133a1faa-eccf-4b6f-9be7-aab3179344a4 req-b8c91769-938e-468b-804c-853537b9f95e service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:08.965355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-133a1faa-eccf-4b6f-9be7-aab3179344a4 req-b8c91769-938e-468b-804c-853537b9f95e service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:08.981039 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-133a1faa-eccf-4b6f-9be7-aab3179344a4 req-b8c91769-938e-468b-804c-853537b9f95e service nova] Creating event network-changed:6f8cd2db-8f57-4877-bbef-d1a00190232b for instance 1b990f50-db09-4b89-af90-d4e0d75e0458 on hv-cinder-73306 Aug 08 02:26:08.987629 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-133a1faa-eccf-4b6f-9be7-aab3179344a4 req-b8c91769-938e-468b-804c-853537b9f95e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047477 Aug 08 02:26:08.989342 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 49/101] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:26:09.011618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f18c232e-1b42-4796-816e-3ebb485bc751 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:09.020695 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f18c232e-1b42-4796-816e-3ebb485bc751 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.177700 Aug 08 02:26:09.021353 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 53/102] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:08 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:09.421561 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-83da9983-b11f-4c3d-b0d2-99699ab11c65 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:09.423168 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-83da9983-b11f-4c3d-b0d2-99699ab11c65 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:09.429160 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83da9983-b11f-4c3d-b0d2-99699ab11c65 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:09.429633 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83da9983-b11f-4c3d-b0d2-99699ab11c65 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:09.430355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83da9983-b11f-4c3d-b0d2-99699ab11c65 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:09.431671 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83da9983-b11f-4c3d-b0d2-99699ab11c65 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:09.432309 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83da9983-b11f-4c3d-b0d2-99699ab11c65 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:09.432733 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83da9983-b11f-4c3d-b0d2-99699ab11c65 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:09.572905 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-83da9983-b11f-4c3d-b0d2-99699ab11c65 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:09.583979 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7354d4e6-bd17-48ef-a069-591ee6d4bd35 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:09.584530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7354d4e6-bd17-48ef-a069-591ee6d4bd35 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:09.591513 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-83da9983-b11f-4c3d-b0d2-99699ab11c65 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.174912 Aug 08 02:26:09.595075 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7354d4e6-bd17-48ef-a069-591ee6d4bd35 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:09.595931 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7354d4e6-bd17-48ef-a069-591ee6d4bd35 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:09.596398 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 50/103] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:09 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:09.597247 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7354d4e6-bd17-48ef-a069-591ee6d4bd35 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:09.601508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7354d4e6-bd17-48ef-a069-591ee6d4bd35 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:09.601982 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7354d4e6-bd17-48ef-a069-591ee6d4bd35 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:09.602754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7354d4e6-bd17-48ef-a069-591ee6d4bd35 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:09.754089 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7354d4e6-bd17-48ef-a069-591ee6d4bd35 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:09.763889 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7354d4e6-bd17-48ef-a069-591ee6d4bd35 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.183661 Aug 08 02:26:09.778287 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 54/104] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:09 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:09.808199 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9cc9be8e-2e75-44fc-8985-2110494a1b6a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:09.808805 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9cc9be8e-2e75-44fc-8985-2110494a1b6a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:09.815019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cc9be8e-2e75-44fc-8985-2110494a1b6a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:09.815506 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cc9be8e-2e75-44fc-8985-2110494a1b6a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:09.815939 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cc9be8e-2e75-44fc-8985-2110494a1b6a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:09.816625 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cc9be8e-2e75-44fc-8985-2110494a1b6a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:09.817239 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cc9be8e-2e75-44fc-8985-2110494a1b6a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:09.817658 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cc9be8e-2e75-44fc-8985-2110494a1b6a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:09.964235 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9cc9be8e-2e75-44fc-8985-2110494a1b6a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:09.974474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9cc9be8e-2e75-44fc-8985-2110494a1b6a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.170455 Aug 08 02:26:09.975388 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 51/105] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:09 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:10.042893 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9c7fd195-a84e-45e6-910a-5e711e70b44b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:10.043509 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9c7fd195-a84e-45e6-910a-5e711e70b44b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:10.049469 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9c7fd195-a84e-45e6-910a-5e711e70b44b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:10.049960 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9c7fd195-a84e-45e6-910a-5e711e70b44b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:10.050428 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9c7fd195-a84e-45e6-910a-5e711e70b44b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:10.051130 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9c7fd195-a84e-45e6-910a-5e711e70b44b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:10.051567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9c7fd195-a84e-45e6-910a-5e711e70b44b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:10.051985 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9c7fd195-a84e-45e6-910a-5e711e70b44b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:10.207283 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-9c7fd195-a84e-45e6-910a-5e711e70b44b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:10.215851 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9c7fd195-a84e-45e6-910a-5e711e70b44b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.178820 Aug 08 02:26:10.216513 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 55/106] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:10 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:10.612685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d3c394d1-5398-482e-b225-03e0d317d6eb tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:10.613288 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d3c394d1-5398-482e-b225-03e0d317d6eb tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:10.615274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=10 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:10.626481 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3c394d1-5398-482e-b225-03e0d317d6eb tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:10.627060 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3c394d1-5398-482e-b225-03e0d317d6eb tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:10.627512 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3c394d1-5398-482e-b225-03e0d317d6eb tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:10.628227 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3c394d1-5398-482e-b225-03e0d317d6eb tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:10.628679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3c394d1-5398-482e-b225-03e0d317d6eb tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:10.631830 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3c394d1-5398-482e-b225-03e0d317d6eb tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:10.785635 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e7d03851-6f33-43ff-b569-67a315b69cc6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:10.786218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e7d03851-6f33-43ff-b569-67a315b69cc6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:10.804124 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7d03851-6f33-43ff-b569-67a315b69cc6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:10.804618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7d03851-6f33-43ff-b569-67a315b69cc6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:10.805061 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7d03851-6f33-43ff-b569-67a315b69cc6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:10.805774 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7d03851-6f33-43ff-b569-67a315b69cc6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:10.806816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7d03851-6f33-43ff-b569-67a315b69cc6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:10.807245 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7d03851-6f33-43ff-b569-67a315b69cc6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:11.099925 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e7d03851-6f33-43ff-b569-67a315b69cc6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:11.109637 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e7d03851-6f33-43ff-b569-67a315b69cc6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.328398 Aug 08 02:26:11.122790 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 56/107] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:10 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:11.128955 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d2231b2a-f7f3-4fd4-ac6a-e04ab370b0f2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:11.130242 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d2231b2a-f7f3-4fd4-ac6a-e04ab370b0f2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:11.140177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2231b2a-f7f3-4fd4-ac6a-e04ab370b0f2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:11.140737 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2231b2a-f7f3-4fd4-ac6a-e04ab370b0f2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:11.141238 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2231b2a-f7f3-4fd4-ac6a-e04ab370b0f2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:11.142695 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2231b2a-f7f3-4fd4-ac6a-e04ab370b0f2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:11.143141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2231b2a-f7f3-4fd4-ac6a-e04ab370b0f2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:11.143754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2231b2a-f7f3-4fd4-ac6a-e04ab370b0f2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:11.154930 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d3c394d1-5398-482e-b225-03e0d317d6eb tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:11.169048 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d3c394d1-5398-482e-b225-03e0d317d6eb tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.559792 Aug 08 02:26:11.170441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 52/108] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:10 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:11.237796 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ca0c69ef-a11c-43ee-8e5e-6f476a32dfd5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:11.238845 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ca0c69ef-a11c-43ee-8e5e-6f476a32dfd5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:11.262547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca0c69ef-a11c-43ee-8e5e-6f476a32dfd5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:11.266082 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca0c69ef-a11c-43ee-8e5e-6f476a32dfd5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:11.266556 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca0c69ef-a11c-43ee-8e5e-6f476a32dfd5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:11.267295 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca0c69ef-a11c-43ee-8e5e-6f476a32dfd5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:11.267752 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca0c69ef-a11c-43ee-8e5e-6f476a32dfd5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:11.268178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca0c69ef-a11c-43ee-8e5e-6f476a32dfd5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:11.744354 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ca0c69ef-a11c-43ee-8e5e-6f476a32dfd5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:11.764216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ca0c69ef-a11c-43ee-8e5e-6f476a32dfd5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.530920 Aug 08 02:26:11.764807 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 53/109] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:11 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:12.035312 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d2231b2a-f7f3-4fd4-ac6a-e04ab370b0f2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:12.043754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d2231b2a-f7f3-4fd4-ac6a-e04ab370b0f2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.919521 Aug 08 02:26:12.044534 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 57/110] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:11 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:12.133085 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-85b24275-8867-41f9-9d77-9dd88056f5f9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:12.133697 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-85b24275-8867-41f9-9d77-9dd88056f5f9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:12.139761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85b24275-8867-41f9-9d77-9dd88056f5f9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:12.140244 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85b24275-8867-41f9-9d77-9dd88056f5f9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:12.140676 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85b24275-8867-41f9-9d77-9dd88056f5f9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:12.141356 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85b24275-8867-41f9-9d77-9dd88056f5f9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:12.141805 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85b24275-8867-41f9-9d77-9dd88056f5f9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:12.142227 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85b24275-8867-41f9-9d77-9dd88056f5f9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:12.193420 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dace70a9-2125-4f1e-9a52-47e8ed3f5df7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:12.194066 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-dace70a9-2125-4f1e-9a52-47e8ed3f5df7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:12.200065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dace70a9-2125-4f1e-9a52-47e8ed3f5df7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:12.200548 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dace70a9-2125-4f1e-9a52-47e8ed3f5df7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:12.200984 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dace70a9-2125-4f1e-9a52-47e8ed3f5df7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:12.201674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dace70a9-2125-4f1e-9a52-47e8ed3f5df7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:12.202131 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dace70a9-2125-4f1e-9a52-47e8ed3f5df7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:12.202589 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dace70a9-2125-4f1e-9a52-47e8ed3f5df7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:12.274000 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-85b24275-8867-41f9-9d77-9dd88056f5f9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:12.281362 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-85b24275-8867-41f9-9d77-9dd88056f5f9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.152233 Aug 08 02:26:12.281937 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 54/111] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:12 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:12.331130 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-dace70a9-2125-4f1e-9a52-47e8ed3f5df7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:12.339104 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-dace70a9-2125-4f1e-9a52-47e8ed3f5df7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.150168 Aug 08 02:26:12.339668 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 58/112] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:12 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:12.784812 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8278960b-75dd-4f0c-9abf-8953674d14a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:12.785450 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8278960b-75dd-4f0c-9abf-8953674d14a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:12.792441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8278960b-75dd-4f0c-9abf-8953674d14a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:12.793043 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8278960b-75dd-4f0c-9abf-8953674d14a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:12.793718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8278960b-75dd-4f0c-9abf-8953674d14a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:12.794573 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8278960b-75dd-4f0c-9abf-8953674d14a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:12.795118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8278960b-75dd-4f0c-9abf-8953674d14a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:12.795596 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8278960b-75dd-4f0c-9abf-8953674d14a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:12.936261 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8278960b-75dd-4f0c-9abf-8953674d14a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:12.944077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8278960b-75dd-4f0c-9abf-8953674d14a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.163099 Aug 08 02:26:12.944686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 55/113] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:12 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:13.064881 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7096a1c1-51fd-4cbe-b483-5160f3bee9fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:13.065545 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7096a1c1-51fd-4cbe-b483-5160f3bee9fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:13.071640 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7096a1c1-51fd-4cbe-b483-5160f3bee9fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:13.072151 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7096a1c1-51fd-4cbe-b483-5160f3bee9fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:13.072576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7096a1c1-51fd-4cbe-b483-5160f3bee9fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:13.073262 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7096a1c1-51fd-4cbe-b483-5160f3bee9fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:13.073703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7096a1c1-51fd-4cbe-b483-5160f3bee9fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:13.074121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7096a1c1-51fd-4cbe-b483-5160f3bee9fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:13.224954 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7096a1c1-51fd-4cbe-b483-5160f3bee9fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:13.234615 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7096a1c1-51fd-4cbe-b483-5160f3bee9fb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.174101 Aug 08 02:26:13.235198 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 59/114] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:13 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:13.302106 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7d46c31a-4385-4921-a44d-e587f80734bb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:13.302746 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7d46c31a-4385-4921-a44d-e587f80734bb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:13.309596 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d46c31a-4385-4921-a44d-e587f80734bb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:13.309596 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d46c31a-4385-4921-a44d-e587f80734bb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:13.310018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d46c31a-4385-4921-a44d-e587f80734bb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:13.310748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d46c31a-4385-4921-a44d-e587f80734bb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:13.311206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d46c31a-4385-4921-a44d-e587f80734bb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:13.311641 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d46c31a-4385-4921-a44d-e587f80734bb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:13.360270 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f723db2a-8c32-4f29-a5ed-57b90db7abdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:13.360983 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f723db2a-8c32-4f29-a5ed-57b90db7abdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:13.367500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f723db2a-8c32-4f29-a5ed-57b90db7abdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:13.368148 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f723db2a-8c32-4f29-a5ed-57b90db7abdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:13.368806 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f723db2a-8c32-4f29-a5ed-57b90db7abdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:13.369554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f723db2a-8c32-4f29-a5ed-57b90db7abdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:13.370070 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f723db2a-8c32-4f29-a5ed-57b90db7abdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:13.370653 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f723db2a-8c32-4f29-a5ed-57b90db7abdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:13.448548 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7d46c31a-4385-4921-a44d-e587f80734bb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:13.456568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7d46c31a-4385-4921-a44d-e587f80734bb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.158288 Aug 08 02:26:13.457249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 56/115] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:13 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:13.514360 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f723db2a-8c32-4f29-a5ed-57b90db7abdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:13.521650 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f723db2a-8c32-4f29-a5ed-57b90db7abdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.165318 Aug 08 02:26:13.522205 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 60/116] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:13 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:13.964582 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dc00580f-3e0a-4b97-bfea-d14bf0d49a58 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:13.965189 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dc00580f-3e0a-4b97-bfea-d14bf0d49a58 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:13.971354 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc00580f-3e0a-4b97-bfea-d14bf0d49a58 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:13.972109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc00580f-3e0a-4b97-bfea-d14bf0d49a58 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:13.972744 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc00580f-3e0a-4b97-bfea-d14bf0d49a58 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:13.973626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc00580f-3e0a-4b97-bfea-d14bf0d49a58 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:13.974110 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc00580f-3e0a-4b97-bfea-d14bf0d49a58 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:13.974625 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc00580f-3e0a-4b97-bfea-d14bf0d49a58 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:13.996114 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:14.149013 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dc00580f-3e0a-4b97-bfea-d14bf0d49a58 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:14.160740 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dc00580f-3e0a-4b97-bfea-d14bf0d49a58 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.200288 Aug 08 02:26:14.163491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 57/117] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:13 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:14.255752 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e4cbf3ce-31db-4ac5-aab9-3d451465f3e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:14.256395 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e4cbf3ce-31db-4ac5-aab9-3d451465f3e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:14.262672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e4cbf3ce-31db-4ac5-aab9-3d451465f3e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:14.263359 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e4cbf3ce-31db-4ac5-aab9-3d451465f3e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:14.263948 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e4cbf3ce-31db-4ac5-aab9-3d451465f3e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:14.264789 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e4cbf3ce-31db-4ac5-aab9-3d451465f3e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:14.265435 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e4cbf3ce-31db-4ac5-aab9-3d451465f3e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:14.265916 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e4cbf3ce-31db-4ac5-aab9-3d451465f3e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:14.480125 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-251ea1e5-add2-4866-bf59-d259e5778a06 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:14.480800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-251ea1e5-add2-4866-bf59-d259e5778a06 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:14.490122 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-251ea1e5-add2-4866-bf59-d259e5778a06 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:14.493312 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-251ea1e5-add2-4866-bf59-d259e5778a06 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:14.494655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-251ea1e5-add2-4866-bf59-d259e5778a06 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:14.495748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-251ea1e5-add2-4866-bf59-d259e5778a06 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:14.496701 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e4cbf3ce-31db-4ac5-aab9-3d451465f3e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:14.496922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-251ea1e5-add2-4866-bf59-d259e5778a06 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:14.497485 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-251ea1e5-add2-4866-bf59-d259e5778a06 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:14.505247 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e4cbf3ce-31db-4ac5-aab9-3d451465f3e1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.253234 Aug 08 02:26:14.505810 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 61/118] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:14 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:14.544553 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3dc9c196-c1b3-45e5-a03d-ca85853a6e22 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:14.545629 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3dc9c196-c1b3-45e5-a03d-ca85853a6e22 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:14.559353 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3dc9c196-c1b3-45e5-a03d-ca85853a6e22 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:14.560012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3dc9c196-c1b3-45e5-a03d-ca85853a6e22 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:14.560609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3dc9c196-c1b3-45e5-a03d-ca85853a6e22 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:14.561735 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3dc9c196-c1b3-45e5-a03d-ca85853a6e22 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:14.562280 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3dc9c196-c1b3-45e5-a03d-ca85853a6e22 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:14.562957 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3dc9c196-c1b3-45e5-a03d-ca85853a6e22 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:14.741200 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-251ea1e5-add2-4866-bf59-d259e5778a06 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:14.750933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-251ea1e5-add2-4866-bf59-d259e5778a06 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.276856 Aug 08 02:26:14.751508 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 58/119] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:14 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:15.043481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3dc9c196-c1b3-45e5-a03d-ca85853a6e22 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:15.047843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:15.053524 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3dc9c196-c1b3-45e5-a03d-ca85853a6e22 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.515213 Aug 08 02:26:15.054219 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 62/120] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:14 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:15.183801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5e59ab60-40cd-4d53-9f2d-4d03490b035b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:15.185198 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5e59ab60-40cd-4d53-9f2d-4d03490b035b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:15.191754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e59ab60-40cd-4d53-9f2d-4d03490b035b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:15.192428 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e59ab60-40cd-4d53-9f2d-4d03490b035b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:15.193219 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e59ab60-40cd-4d53-9f2d-4d03490b035b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:15.193781 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e59ab60-40cd-4d53-9f2d-4d03490b035b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:15.195642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e59ab60-40cd-4d53-9f2d-4d03490b035b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:15.195642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e59ab60-40cd-4d53-9f2d-4d03490b035b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:15.434753 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5e59ab60-40cd-4d53-9f2d-4d03490b035b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:15.452087 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5e59ab60-40cd-4d53-9f2d-4d03490b035b tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.272862 Aug 08 02:26:15.452805 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 59/121] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:15 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:15.528243 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-13bf8baf-82dd-4da4-b304-877de81612b2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:15.528880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-13bf8baf-82dd-4da4-b304-877de81612b2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:15.539523 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13bf8baf-82dd-4da4-b304-877de81612b2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:15.540004 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13bf8baf-82dd-4da4-b304-877de81612b2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:15.540454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13bf8baf-82dd-4da4-b304-877de81612b2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:15.542642 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13bf8baf-82dd-4da4-b304-877de81612b2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:15.545095 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13bf8baf-82dd-4da4-b304-877de81612b2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:15.545547 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13bf8baf-82dd-4da4-b304-877de81612b2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:15.730384 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-13bf8baf-82dd-4da4-b304-877de81612b2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:15.741112 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-13bf8baf-82dd-4da4-b304-877de81612b2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.216676 Aug 08 02:26:15.742387 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 63/122] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:15 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:15.777181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-402a9f74-0fb7-44cc-a5fb-d35661994ca9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:15.777758 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-402a9f74-0fb7-44cc-a5fb-d35661994ca9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:15.784276 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-402a9f74-0fb7-44cc-a5fb-d35661994ca9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:15.784990 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-402a9f74-0fb7-44cc-a5fb-d35661994ca9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:15.785649 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-402a9f74-0fb7-44cc-a5fb-d35661994ca9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:15.786619 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-402a9f74-0fb7-44cc-a5fb-d35661994ca9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:15.787244 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-402a9f74-0fb7-44cc-a5fb-d35661994ca9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:15.788137 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-402a9f74-0fb7-44cc-a5fb-d35661994ca9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:15.957340 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-402a9f74-0fb7-44cc-a5fb-d35661994ca9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:15.966178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-402a9f74-0fb7-44cc-a5fb-d35661994ca9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.194942 Aug 08 02:26:15.966789 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 60/123] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:15 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:16.075512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6816f03d-c2f2-4af1-bb08-3edb340e1926 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:16.076135 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6816f03d-c2f2-4af1-bb08-3edb340e1926 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:16.086717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6816f03d-c2f2-4af1-bb08-3edb340e1926 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:16.087821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6816f03d-c2f2-4af1-bb08-3edb340e1926 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:16.088468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6816f03d-c2f2-4af1-bb08-3edb340e1926 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:16.089380 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6816f03d-c2f2-4af1-bb08-3edb340e1926 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:16.090057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6816f03d-c2f2-4af1-bb08-3edb340e1926 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:16.091435 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6816f03d-c2f2-4af1-bb08-3edb340e1926 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:16.313697 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6816f03d-c2f2-4af1-bb08-3edb340e1926 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:16.322052 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6816f03d-c2f2-4af1-bb08-3edb340e1926 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.250292 Aug 08 02:26:16.322905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 64/124] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:16 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:16.473143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c0b9adef-e146-4931-98fa-8d30bc9934db tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:16.474453 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c0b9adef-e146-4931-98fa-8d30bc9934db tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:16.481208 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c0b9adef-e146-4931-98fa-8d30bc9934db tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:16.481691 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c0b9adef-e146-4931-98fa-8d30bc9934db tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:16.482432 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c0b9adef-e146-4931-98fa-8d30bc9934db tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:16.483269 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c0b9adef-e146-4931-98fa-8d30bc9934db tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:16.483883 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c0b9adef-e146-4931-98fa-8d30bc9934db tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:16.484555 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c0b9adef-e146-4931-98fa-8d30bc9934db tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:16.639285 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c0b9adef-e146-4931-98fa-8d30bc9934db tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:16.648798 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c0b9adef-e146-4931-98fa-8d30bc9934db tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.179837 Aug 08 02:26:16.649641 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 61/125] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:16 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:16.767185 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9de8b164-de6a-4476-81fa-e957f175e27b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:16.768802 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9de8b164-de6a-4476-81fa-e957f175e27b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:16.788255 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9de8b164-de6a-4476-81fa-e957f175e27b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:16.789245 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9de8b164-de6a-4476-81fa-e957f175e27b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:16.789892 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9de8b164-de6a-4476-81fa-e957f175e27b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:16.791362 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9de8b164-de6a-4476-81fa-e957f175e27b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:16.792182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9de8b164-de6a-4476-81fa-e957f175e27b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:16.792765 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9de8b164-de6a-4476-81fa-e957f175e27b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:16.992393 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c1e8f0de-3674-4fbb-9b7c-d91187600521 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:16.993046 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c1e8f0de-3674-4fbb-9b7c-d91187600521 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:17.003580 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1e8f0de-3674-4fbb-9b7c-d91187600521 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:17.005899 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1e8f0de-3674-4fbb-9b7c-d91187600521 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:17.006501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1e8f0de-3674-4fbb-9b7c-d91187600521 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:17.009590 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1e8f0de-3674-4fbb-9b7c-d91187600521 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:17.010077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1e8f0de-3674-4fbb-9b7c-d91187600521 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:17.011947 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1e8f0de-3674-4fbb-9b7c-d91187600521 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:17.090878 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-9de8b164-de6a-4476-81fa-e957f175e27b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:17.106663 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9de8b164-de6a-4476-81fa-e957f175e27b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.342523 Aug 08 02:26:17.108972 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 65/126] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:16 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:17.346061 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fbf53e2f-2045-49a6-8217-fa43dca9d5ed tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:17.347096 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-fbf53e2f-2045-49a6-8217-fa43dca9d5ed tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:17.361895 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fbf53e2f-2045-49a6-8217-fa43dca9d5ed tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:17.362724 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fbf53e2f-2045-49a6-8217-fa43dca9d5ed tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:17.364203 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fbf53e2f-2045-49a6-8217-fa43dca9d5ed tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:17.369434 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fbf53e2f-2045-49a6-8217-fa43dca9d5ed tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:17.370599 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fbf53e2f-2045-49a6-8217-fa43dca9d5ed tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:17.371334 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fbf53e2f-2045-49a6-8217-fa43dca9d5ed tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:17.663472 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c1e8f0de-3674-4fbb-9b7c-d91187600521 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:17.676434 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c1e8f0de-3674-4fbb-9b7c-d91187600521 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.692351 Aug 08 02:26:17.677922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 62/127] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:16 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:17.682941 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7e67279f-64df-4f32-8415-5a90dbf615b9 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:17.683635 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7e67279f-64df-4f32-8415-5a90dbf615b9 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:17.694024 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e67279f-64df-4f32-8415-5a90dbf615b9 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:17.694629 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e67279f-64df-4f32-8415-5a90dbf615b9 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:17.695233 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e67279f-64df-4f32-8415-5a90dbf615b9 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:17.695944 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e67279f-64df-4f32-8415-5a90dbf615b9 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:17.696400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e67279f-64df-4f32-8415-5a90dbf615b9 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:17.696973 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e67279f-64df-4f32-8415-5a90dbf615b9 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:18.000392 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7e67279f-64df-4f32-8415-5a90dbf615b9 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:18.013561 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7e67279f-64df-4f32-8415-5a90dbf615b9 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.331423 Aug 08 02:26:18.016754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 63/128] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:17 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:18.054924 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-fbf53e2f-2045-49a6-8217-fa43dca9d5ed tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:18.062624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fbf53e2f-2045-49a6-8217-fa43dca9d5ed tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.723328 Aug 08 02:26:18.063215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 66/129] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:17 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:18.128968 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-85cb4b64-0029-4ad4-8dce-c8b8fb654a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:18.129594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-85cb4b64-0029-4ad4-8dce-c8b8fb654a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:18.143251 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85cb4b64-0029-4ad4-8dce-c8b8fb654a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:18.146082 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85cb4b64-0029-4ad4-8dce-c8b8fb654a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:18.146808 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85cb4b64-0029-4ad4-8dce-c8b8fb654a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:18.147527 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85cb4b64-0029-4ad4-8dce-c8b8fb654a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:18.147979 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85cb4b64-0029-4ad4-8dce-c8b8fb654a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:18.148411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85cb4b64-0029-4ad4-8dce-c8b8fb654a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:18.425985 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-85cb4b64-0029-4ad4-8dce-c8b8fb654a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:18.436437 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-85cb4b64-0029-4ad4-8dce-c8b8fb654a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.310824 Aug 08 02:26:18.437636 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 64/130] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:18 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:18.700066 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2ab93694-c2ed-421b-be21-41815f8b3ce0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:18.701098 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2ab93694-c2ed-421b-be21-41815f8b3ce0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:18.710717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2ab93694-c2ed-421b-be21-41815f8b3ce0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:18.711905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2ab93694-c2ed-421b-be21-41815f8b3ce0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:18.712636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2ab93694-c2ed-421b-be21-41815f8b3ce0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:18.713721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2ab93694-c2ed-421b-be21-41815f8b3ce0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:18.714553 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2ab93694-c2ed-421b-be21-41815f8b3ce0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:18.715286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2ab93694-c2ed-421b-be21-41815f8b3ce0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:18.797868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-624770f2-1668-4354-82a7-96330b3cf408 req-fc3c8af7-cfa2-4335-ac3e-3086ab083dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b248f4-c0a5-4bf3-b424-5e953068e4a5", "name": "network-vif-plugged", "status": "completed", "tag": "9b89e848-9490-437b-b21c-d15edb41b4c4"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:18.813139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-624770f2-1668-4354-82a7-96330b3cf408 req-fc3c8af7-cfa2-4335-ac3e-3086ab083dcf service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:18.813931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-624770f2-1668-4354-82a7-96330b3cf408 req-fc3c8af7-cfa2-4335-ac3e-3086ab083dcf service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:18.814537 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-624770f2-1668-4354-82a7-96330b3cf408 req-fc3c8af7-cfa2-4335-ac3e-3086ab083dcf service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:18.826345 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-624770f2-1668-4354-82a7-96330b3cf408 req-fc3c8af7-cfa2-4335-ac3e-3086ab083dcf service nova] Creating event network-vif-plugged:9b89e848-9490-437b-b21c-d15edb41b4c4 for instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 on hv-cinder-73306 Aug 08 02:26:18.831756 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-624770f2-1668-4354-82a7-96330b3cf408 req-fc3c8af7-cfa2-4335-ac3e-3086ab083dcf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118504 Aug 08 02:26:18.832856 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 65/131] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:26:18.872586 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2ab93694-c2ed-421b-be21-41815f8b3ce0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:18.881817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2ab93694-c2ed-421b-be21-41815f8b3ce0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.187453 Aug 08 02:26:18.883824 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 67/132] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:18 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:19.038193 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f1bc541c-4374-46a5-aae0-39f6329d8052 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:19.039185 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f1bc541c-4374-46a5-aae0-39f6329d8052 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:19.046492 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1bc541c-4374-46a5-aae0-39f6329d8052 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:19.047085 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1bc541c-4374-46a5-aae0-39f6329d8052 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:19.047591 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1bc541c-4374-46a5-aae0-39f6329d8052 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:19.048369 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1bc541c-4374-46a5-aae0-39f6329d8052 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:19.048901 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1bc541c-4374-46a5-aae0-39f6329d8052 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:19.052412 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1bc541c-4374-46a5-aae0-39f6329d8052 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:19.087336 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d91ddae4-1475-43b4-be57-95477d344937 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:19.087942 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d91ddae4-1475-43b4-be57-95477d344937 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:19.096961 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d91ddae4-1475-43b4-be57-95477d344937 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:19.097682 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d91ddae4-1475-43b4-be57-95477d344937 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:19.098443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d91ddae4-1475-43b4-be57-95477d344937 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:19.099526 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d91ddae4-1475-43b4-be57-95477d344937 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:19.100190 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d91ddae4-1475-43b4-be57-95477d344937 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:19.100820 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d91ddae4-1475-43b4-be57-95477d344937 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:19.228869 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f1bc541c-4374-46a5-aae0-39f6329d8052 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:19.241155 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f1bc541c-4374-46a5-aae0-39f6329d8052 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.207748 Aug 08 02:26:19.241737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 66/133] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:19 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:19.276422 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d91ddae4-1475-43b4-be57-95477d344937 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:19.285407 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d91ddae4-1475-43b4-be57-95477d344937 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.201783 Aug 08 02:26:19.286187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 68/134] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:19 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:19.459466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a1262678-dbf5-4171-8df5-9b18a0b1dbb9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:19.460219 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a1262678-dbf5-4171-8df5-9b18a0b1dbb9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:19.467189 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1262678-dbf5-4171-8df5-9b18a0b1dbb9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:19.467977 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1262678-dbf5-4171-8df5-9b18a0b1dbb9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:19.468495 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1262678-dbf5-4171-8df5-9b18a0b1dbb9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:19.469513 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1262678-dbf5-4171-8df5-9b18a0b1dbb9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:19.470007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1262678-dbf5-4171-8df5-9b18a0b1dbb9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:19.470462 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a1262678-dbf5-4171-8df5-9b18a0b1dbb9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:19.638871 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a1262678-dbf5-4171-8df5-9b18a0b1dbb9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:19.646940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a1262678-dbf5-4171-8df5-9b18a0b1dbb9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.191730 Aug 08 02:26:19.647874 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 67/135] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:19 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:19.905532 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e09161e0-219c-442a-b2c1-f7a39593e218 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:19.906665 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e09161e0-219c-442a-b2c1-f7a39593e218 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:19.920522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e09161e0-219c-442a-b2c1-f7a39593e218 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:19.921570 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e09161e0-219c-442a-b2c1-f7a39593e218 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:19.922904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e09161e0-219c-442a-b2c1-f7a39593e218 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:19.925912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e09161e0-219c-442a-b2c1-f7a39593e218 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:19.927596 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e09161e0-219c-442a-b2c1-f7a39593e218 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:19.930912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e09161e0-219c-442a-b2c1-f7a39593e218 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:20.262797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-95273059-ed8a-42e4-8ee5-60a29708660c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:20.264036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-95273059-ed8a-42e4-8ee5-60a29708660c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:20.282186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95273059-ed8a-42e4-8ee5-60a29708660c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:20.283040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95273059-ed8a-42e4-8ee5-60a29708660c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:20.283844 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95273059-ed8a-42e4-8ee5-60a29708660c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:20.284773 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95273059-ed8a-42e4-8ee5-60a29708660c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:20.285429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95273059-ed8a-42e4-8ee5-60a29708660c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:20.286125 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95273059-ed8a-42e4-8ee5-60a29708660c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:20.512574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-95273059-ed8a-42e4-8ee5-60a29708660c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:20.523220 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-95273059-ed8a-42e4-8ee5-60a29708660c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.265769 Aug 08 02:26:20.537047 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 68/136] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:20 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:20.541340 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b40ab6a5-f85b-4c61-bf87-5bbffd221b55 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:20.541953 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b40ab6a5-f85b-4c61-bf87-5bbffd221b55 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:20.550771 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b40ab6a5-f85b-4c61-bf87-5bbffd221b55 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:20.551256 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b40ab6a5-f85b-4c61-bf87-5bbffd221b55 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:20.551683 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b40ab6a5-f85b-4c61-bf87-5bbffd221b55 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:20.552371 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b40ab6a5-f85b-4c61-bf87-5bbffd221b55 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:20.552833 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b40ab6a5-f85b-4c61-bf87-5bbffd221b55 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:20.553282 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b40ab6a5-f85b-4c61-bf87-5bbffd221b55 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:20.707091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b40ab6a5-f85b-4c61-bf87-5bbffd221b55 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:20.716095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b40ab6a5-f85b-4c61-bf87-5bbffd221b55 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.178495 Aug 08 02:26:20.716838 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 69/137] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:20 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:20.721868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-479ad192-a0d4-4288-87aa-b4a8f62d8b80 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:20.722745 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-479ad192-a0d4-4288-87aa-b4a8f62d8b80 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:20.733272 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e09161e0-219c-442a-b2c1-f7a39593e218 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:20.742553 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e09161e0-219c-442a-b2c1-f7a39593e218 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.842412 Aug 08 02:26:20.743132 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 69/138] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:19 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:20.743785 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-479ad192-a0d4-4288-87aa-b4a8f62d8b80 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:20.744409 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-479ad192-a0d4-4288-87aa-b4a8f62d8b80 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:20.745191 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-479ad192-a0d4-4288-87aa-b4a8f62d8b80 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:20.746186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-479ad192-a0d4-4288-87aa-b4a8f62d8b80 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:20.746992 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-479ad192-a0d4-4288-87aa-b4a8f62d8b80 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:20.747889 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-479ad192-a0d4-4288-87aa-b4a8f62d8b80 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:20.931799 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-479ad192-a0d4-4288-87aa-b4a8f62d8b80 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:20.942708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-479ad192-a0d4-4288-87aa-b4a8f62d8b80 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.224391 Aug 08 02:26:20.943596 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 70/139] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:20 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:21.545705 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4a18d097-d57a-47ae-a3e5-9fcf5281aa8f tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:21.546356 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4a18d097-d57a-47ae-a3e5-9fcf5281aa8f tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:21.552476 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4a18d097-d57a-47ae-a3e5-9fcf5281aa8f tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:21.552965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4a18d097-d57a-47ae-a3e5-9fcf5281aa8f tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:21.553400 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4a18d097-d57a-47ae-a3e5-9fcf5281aa8f tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:21.554083 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4a18d097-d57a-47ae-a3e5-9fcf5281aa8f tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:21.554736 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4a18d097-d57a-47ae-a3e5-9fcf5281aa8f tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:21.555307 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4a18d097-d57a-47ae-a3e5-9fcf5281aa8f tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:21.704184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4a18d097-d57a-47ae-a3e5-9fcf5281aa8f tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:21.711468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4a18d097-d57a-47ae-a3e5-9fcf5281aa8f tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.169592 Aug 08 02:26:21.712100 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 70/140] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:21 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:21.741611 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7350f74a-78b7-40a6-964c-0ee3cfb804c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:21.742649 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7350f74a-78b7-40a6-964c-0ee3cfb804c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:21.749094 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7350f74a-78b7-40a6-964c-0ee3cfb804c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:21.749569 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7350f74a-78b7-40a6-964c-0ee3cfb804c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:21.750001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7350f74a-78b7-40a6-964c-0ee3cfb804c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:21.750708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7350f74a-78b7-40a6-964c-0ee3cfb804c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:21.751158 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7350f74a-78b7-40a6-964c-0ee3cfb804c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:21.751576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7350f74a-78b7-40a6-964c-0ee3cfb804c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:21.764726 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-be5ce40a-d3b6-4410-a53c-f52852198b26 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:21.765436 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-be5ce40a-d3b6-4410-a53c-f52852198b26 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:21.771714 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-be5ce40a-d3b6-4410-a53c-f52852198b26 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:21.772206 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-be5ce40a-d3b6-4410-a53c-f52852198b26 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:21.772641 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-be5ce40a-d3b6-4410-a53c-f52852198b26 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:21.773328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-be5ce40a-d3b6-4410-a53c-f52852198b26 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:21.773774 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-be5ce40a-d3b6-4410-a53c-f52852198b26 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:21.774194 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-be5ce40a-d3b6-4410-a53c-f52852198b26 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:21.886115 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7350f74a-78b7-40a6-964c-0ee3cfb804c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:21.894012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7350f74a-78b7-40a6-964c-0ee3cfb804c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.157135 Aug 08 02:26:21.894780 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 71/141] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:21 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:21.904799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-be5ce40a-d3b6-4410-a53c-f52852198b26 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:21.912240 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-be5ce40a-d3b6-4410-a53c-f52852198b26 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.152122 Aug 08 02:26:21.912924 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 71/142] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:21 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:21.963768 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f8f53b60-5e49-4d35-a2b6-b0a2032fa700 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:21.964400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f8f53b60-5e49-4d35-a2b6-b0a2032fa700 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:21.970100 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8f53b60-5e49-4d35-a2b6-b0a2032fa700 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:21.970601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8f53b60-5e49-4d35-a2b6-b0a2032fa700 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:21.971027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8f53b60-5e49-4d35-a2b6-b0a2032fa700 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:21.971697 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8f53b60-5e49-4d35-a2b6-b0a2032fa700 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:21.972139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8f53b60-5e49-4d35-a2b6-b0a2032fa700 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:21.972574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8f53b60-5e49-4d35-a2b6-b0a2032fa700 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:22.109823 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f8f53b60-5e49-4d35-a2b6-b0a2032fa700 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:22.117498 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f8f53b60-5e49-4d35-a2b6-b0a2032fa700 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.157491 Aug 08 02:26:22.118081 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 72/143] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:21 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:22.438010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-c429592e-7aaa-4615-aa30-97fd5fc198c8 req-15ddfdb8-5fdf-4423-994f-01b7614e03aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13364414-05f0-413b-bd7e-27ad8c210e32", "name": "network-vif-plugged", "status": "completed", "tag": "dbb78041-5c91-4099-9e3f-6221c1a48511"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:22.447695 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-c429592e-7aaa-4615-aa30-97fd5fc198c8 req-15ddfdb8-5fdf-4423-994f-01b7614e03aa service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:22.448166 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-c429592e-7aaa-4615-aa30-97fd5fc198c8 req-15ddfdb8-5fdf-4423-994f-01b7614e03aa service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:22.448588 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-c429592e-7aaa-4615-aa30-97fd5fc198c8 req-15ddfdb8-5fdf-4423-994f-01b7614e03aa service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:22.466609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-c429592e-7aaa-4615-aa30-97fd5fc198c8 req-15ddfdb8-5fdf-4423-994f-01b7614e03aa service nova] Creating event network-vif-plugged:dbb78041-5c91-4099-9e3f-6221c1a48511 for instance 13364414-05f0-413b-bd7e-27ad8c210e32 on hv-cinder-73306 Aug 08 02:26:22.471974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-c429592e-7aaa-4615-aa30-97fd5fc198c8 req-15ddfdb8-5fdf-4423-994f-01b7614e03aa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038495 Aug 08 02:26:22.472583 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 72/144] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:22.553724 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-163195901", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "networks": [{"uuid": "e663bc2c-6808-4d79-a335-4f90bd6f6339"}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:22.624277 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] validate_networks() for [('e663bc2c-6808-4d79-a335-4f90bd6f6339', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:26:22.735331 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c1a5103f-e5f0-45c9-89d9-0451ee1d73a2 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:22.736078 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c1a5103f-e5f0-45c9-89d9-0451ee1d73a2 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:22.759483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c1a5103f-e5f0-45c9-89d9-0451ee1d73a2 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:22.759483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c1a5103f-e5f0-45c9-89d9-0451ee1d73a2 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:22.759483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c1a5103f-e5f0-45c9-89d9-0451ee1d73a2 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:22.761941 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c1a5103f-e5f0-45c9-89d9-0451ee1d73a2 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:22.762818 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c1a5103f-e5f0-45c9-89d9-0451ee1d73a2 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:22.765426 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c1a5103f-e5f0-45c9-89d9-0451ee1d73a2 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:22.962523 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c1a5103f-e5f0-45c9-89d9-0451ee1d73a2 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:22.971584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c1a5103f-e5f0-45c9-89d9-0451ee1d73a2 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.243015 Aug 08 02:26:22.972160 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 73/145] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:22 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:22.977897 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-49f8979c-b742-47cb-841c-d6991ed14ede tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:22.978767 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-49f8979c-b742-47cb-841c-d6991ed14ede tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:22.986031 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-49f8979c-b742-47cb-841c-d6991ed14ede tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:22.986732 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-49f8979c-b742-47cb-841c-d6991ed14ede tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:22.987406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-49f8979c-b742-47cb-841c-d6991ed14ede tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:22.988285 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-49f8979c-b742-47cb-841c-d6991ed14ede tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:22.988885 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-49f8979c-b742-47cb-841c-d6991ed14ede tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:22.989302 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-49f8979c-b742-47cb-841c-d6991ed14ede tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:23.099185 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:26:23.099808 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:26:23.100564 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:26:23.101182 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:26:23.101796 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:26:23.114732 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:23.115463 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:23.116120 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:23.117201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:23.117882 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:23.118576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:23.121430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-49f8979c-b742-47cb-841c-d6991ed14ede tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:23.131011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-49f8979c-b742-47cb-841c-d6991ed14ede tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.157310 Aug 08 02:26:23.131783 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 74/146] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:22 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:23.136662 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ce865cf9-6221-4861-8115-2aed68d45415 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:23.137499 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ce865cf9-6221-4861-8115-2aed68d45415 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:23.140728 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Getting quotas for project d3cc8b8bc4964df4a494173af8540c45. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:26:23.145282 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Getting quotas for user 6916c2afef12490f921d99c5047b4dce and project d3cc8b8bc4964df4a494173af8540c45. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:26:23.158088 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ce865cf9-6221-4861-8115-2aed68d45415 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:23.159136 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ce865cf9-6221-4861-8115-2aed68d45415 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:23.160020 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ce865cf9-6221-4861-8115-2aed68d45415 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:23.161135 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ce865cf9-6221-4861-8115-2aed68d45415 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:23.161949 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ce865cf9-6221-4861-8115-2aed68d45415 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:23.162547 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ce865cf9-6221-4861-8115-2aed68d45415 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:23.163062 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:26:23.166741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:26:23.218563 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-77066050-484c-4127-b926-f983805858c8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668497 Aug 08 02:26:23.220101 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 73/147] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:26:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:26:23.225461 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8490e7d0-7540-4e59-a1e2-91e43af57864 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:23.226441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8490e7d0-7540-4e59-a1e2-91e43af57864 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:23.234294 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8490e7d0-7540-4e59-a1e2-91e43af57864 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:23.234993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8490e7d0-7540-4e59-a1e2-91e43af57864 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:23.235734 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8490e7d0-7540-4e59-a1e2-91e43af57864 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:23.236595 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8490e7d0-7540-4e59-a1e2-91e43af57864 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:23.237311 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8490e7d0-7540-4e59-a1e2-91e43af57864 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:23.238645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8490e7d0-7540-4e59-a1e2-91e43af57864 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:23.318495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ce865cf9-6221-4861-8115-2aed68d45415 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:23.326518 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ce865cf9-6221-4861-8115-2aed68d45415 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.193508 Aug 08 02:26:23.327097 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 75/148] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:23 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:23.332679 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a8407e34-0ade-4701-b7c4-588ec3e069d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:23.333460 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a8407e34-0ade-4701-b7c4-588ec3e069d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:23.387413 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8490e7d0-7540-4e59-a1e2-91e43af57864 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:23.387762 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a8407e34-0ade-4701-b7c4-588ec3e069d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:23.394595 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a8407e34-0ade-4701-b7c4-588ec3e069d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1213 microversion: 2.1 time: 0.065770 Aug 08 02:26:23.395160 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 76/149] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:23 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:23.396749 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8490e7d0-7540-4e59-a1e2-91e43af57864 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.175496 Aug 08 02:26:23.397461 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 74/150] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:23 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:23.993253 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6c9b3bf3-5111-42a6-b816-7bc094ceb30c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:23.993863 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6c9b3bf3-5111-42a6-b816-7bc094ceb30c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:24.000783 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6c9b3bf3-5111-42a6-b816-7bc094ceb30c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:24.001263 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6c9b3bf3-5111-42a6-b816-7bc094ceb30c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:24.001688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6c9b3bf3-5111-42a6-b816-7bc094ceb30c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:24.002880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6c9b3bf3-5111-42a6-b816-7bc094ceb30c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:24.003415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6c9b3bf3-5111-42a6-b816-7bc094ceb30c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:24.003841 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6c9b3bf3-5111-42a6-b816-7bc094ceb30c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:24.154445 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-417b24de-1f9f-47ac-9fc4-3aa444c52991 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:24.155517 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6c9b3bf3-5111-42a6-b816-7bc094ceb30c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:24.156811 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-417b24de-1f9f-47ac-9fc4-3aa444c52991 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:24.164351 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:24.165015 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6c9b3bf3-5111-42a6-b816-7bc094ceb30c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.175606 Aug 08 02:26:24.178612 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-417b24de-1f9f-47ac-9fc4-3aa444c52991 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:24.178612 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-417b24de-1f9f-47ac-9fc4-3aa444c52991 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:24.178612 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-417b24de-1f9f-47ac-9fc4-3aa444c52991 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:24.179275 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-417b24de-1f9f-47ac-9fc4-3aa444c52991 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:24.179749 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-417b24de-1f9f-47ac-9fc4-3aa444c52991 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:24.180177 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-417b24de-1f9f-47ac-9fc4-3aa444c52991 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:24.180311 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 77/151] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:23 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:24.210904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:24.350815 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c2effa5b-2cd0-4977-be7d-04f390da061b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:24.351797 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c2effa5b-2cd0-4977-be7d-04f390da061b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:24.367308 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c2effa5b-2cd0-4977-be7d-04f390da061b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:24.368380 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c2effa5b-2cd0-4977-be7d-04f390da061b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:24.369409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c2effa5b-2cd0-4977-be7d-04f390da061b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:24.371389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c2effa5b-2cd0-4977-be7d-04f390da061b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:24.371964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c2effa5b-2cd0-4977-be7d-04f390da061b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:24.373655 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c2effa5b-2cd0-4977-be7d-04f390da061b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:24.452336 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-417b24de-1f9f-47ac-9fc4-3aa444c52991 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:24.463528 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-417b24de-1f9f-47ac-9fc4-3aa444c52991 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.315172 Aug 08 02:26:24.465353 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 75/152] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:24 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:24.472340 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-923eb47a-51ea-49fd-8fe5-7ad3a8fe13ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:24.473238 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-923eb47a-51ea-49fd-8fe5-7ad3a8fe13ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:24.485672 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-923eb47a-51ea-49fd-8fe5-7ad3a8fe13ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:24.486273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-923eb47a-51ea-49fd-8fe5-7ad3a8fe13ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:24.486999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-923eb47a-51ea-49fd-8fe5-7ad3a8fe13ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:24.487900 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-923eb47a-51ea-49fd-8fe5-7ad3a8fe13ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:24.488535 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-923eb47a-51ea-49fd-8fe5-7ad3a8fe13ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:24.489146 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-923eb47a-51ea-49fd-8fe5-7ad3a8fe13ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:24.577142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-923eb47a-51ea-49fd-8fe5-7ad3a8fe13ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:24.587673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-923eb47a-51ea-49fd-8fe5-7ad3a8fe13ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1217 microversion: 2.1 time: 0.121005 Aug 08 02:26:24.602430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 76/153] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:24 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:24.604079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c2effa5b-2cd0-4977-be7d-04f390da061b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:24.613073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ef96c07a-c0b6-4777-9ed7-cd320d9cef7d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:24.613809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ef96c07a-c0b6-4777-9ed7-cd320d9cef7d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:24.615584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c2effa5b-2cd0-4977-be7d-04f390da061b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.271742 Aug 08 02:26:24.616168 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 78/154] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:24 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:24.621171 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef96c07a-c0b6-4777-9ed7-cd320d9cef7d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:24.621796 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef96c07a-c0b6-4777-9ed7-cd320d9cef7d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:24.622377 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef96c07a-c0b6-4777-9ed7-cd320d9cef7d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:24.622884 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-523d5592-3477-4467-a901-7ff30d9180e4 req-2fcffd5f-4e1a-455e-bccb-7a67e62a58e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b990f50-db09-4b89-af90-d4e0d75e0458", "name": "network-vif-plugged", "status": "completed", "tag": "6f8cd2db-8f57-4877-bbef-d1a00190232b"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:24.623271 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef96c07a-c0b6-4777-9ed7-cd320d9cef7d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:24.623976 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef96c07a-c0b6-4777-9ed7-cd320d9cef7d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:24.624497 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef96c07a-c0b6-4777-9ed7-cd320d9cef7d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:24.634687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-523d5592-3477-4467-a901-7ff30d9180e4 req-2fcffd5f-4e1a-455e-bccb-7a67e62a58e7 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:24.635339 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-523d5592-3477-4467-a901-7ff30d9180e4 req-2fcffd5f-4e1a-455e-bccb-7a67e62a58e7 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:24.636242 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-523d5592-3477-4467-a901-7ff30d9180e4 req-2fcffd5f-4e1a-455e-bccb-7a67e62a58e7 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:24.647666 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-523d5592-3477-4467-a901-7ff30d9180e4 req-2fcffd5f-4e1a-455e-bccb-7a67e62a58e7 service nova] Creating event network-vif-plugged:6f8cd2db-8f57-4877-bbef-d1a00190232b for instance 1b990f50-db09-4b89-af90-d4e0d75e0458 on hv-cinder-73306 Aug 08 02:26:24.653296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-523d5592-3477-4467-a901-7ff30d9180e4 req-2fcffd5f-4e1a-455e-bccb-7a67e62a58e7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035885 Aug 08 02:26:24.653884 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 79/155] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:24.768563 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ef96c07a-c0b6-4777-9ed7-cd320d9cef7d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:24.777719 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ef96c07a-c0b6-4777-9ed7-cd320d9cef7d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.173319 Aug 08 02:26:24.778397 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 77/156] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:24 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:25.191139 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-646d4e2c-225b-4cec-914d-92dd53973d8a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:25.192456 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-646d4e2c-225b-4cec-914d-92dd53973d8a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:25.200966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-646d4e2c-225b-4cec-914d-92dd53973d8a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:25.201946 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-646d4e2c-225b-4cec-914d-92dd53973d8a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:25.202665 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-646d4e2c-225b-4cec-914d-92dd53973d8a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:25.203451 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-646d4e2c-225b-4cec-914d-92dd53973d8a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:25.204128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-646d4e2c-225b-4cec-914d-92dd53973d8a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:25.204914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-646d4e2c-225b-4cec-914d-92dd53973d8a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:25.486609 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5a2819d4-6e84-436d-b16e-43d02a9cc284 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:25.487229 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5a2819d4-6e84-436d-b16e-43d02a9cc284 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:25.493715 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a2819d4-6e84-436d-b16e-43d02a9cc284 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:25.494210 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a2819d4-6e84-436d-b16e-43d02a9cc284 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:25.494667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a2819d4-6e84-436d-b16e-43d02a9cc284 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:25.495566 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a2819d4-6e84-436d-b16e-43d02a9cc284 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:25.496195 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a2819d4-6e84-436d-b16e-43d02a9cc284 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:25.496776 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a2819d4-6e84-436d-b16e-43d02a9cc284 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:25.505300 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-646d4e2c-225b-4cec-914d-92dd53973d8a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:25.516951 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-646d4e2c-225b-4cec-914d-92dd53973d8a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.334091 Aug 08 02:26:25.517533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 80/157] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:25 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:25.612016 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d17b534c-63c4-45e4-b1f1-2e7eb2a9cbe4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:25.612625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d17b534c-63c4-45e4-b1f1-2e7eb2a9cbe4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:25.619063 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d17b534c-63c4-45e4-b1f1-2e7eb2a9cbe4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:25.619552 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d17b534c-63c4-45e4-b1f1-2e7eb2a9cbe4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:25.620272 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d17b534c-63c4-45e4-b1f1-2e7eb2a9cbe4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:25.621042 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d17b534c-63c4-45e4-b1f1-2e7eb2a9cbe4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:25.621910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d17b534c-63c4-45e4-b1f1-2e7eb2a9cbe4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:25.622025 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d17b534c-63c4-45e4-b1f1-2e7eb2a9cbe4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:25.649307 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5a2819d4-6e84-436d-b16e-43d02a9cc284 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:25.658169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5a2819d4-6e84-436d-b16e-43d02a9cc284 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.175686 Aug 08 02:26:25.658793 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 78/158] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:25 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:25.668498 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-374631ef-b48e-42c6-b4cc-a021204b7eef tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:25.669159 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-374631ef-b48e-42c6-b4cc-a021204b7eef tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:25.675256 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-374631ef-b48e-42c6-b4cc-a021204b7eef tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:25.675736 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-374631ef-b48e-42c6-b4cc-a021204b7eef tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:25.676169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-374631ef-b48e-42c6-b4cc-a021204b7eef tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:25.676860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-374631ef-b48e-42c6-b4cc-a021204b7eef tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:25.677313 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-374631ef-b48e-42c6-b4cc-a021204b7eef tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:25.677906 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-374631ef-b48e-42c6-b4cc-a021204b7eef tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:25.691399 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d17b534c-63c4-45e4-b1f1-2e7eb2a9cbe4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:25.695301 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:25.700695 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d17b534c-63c4-45e4-b1f1-2e7eb2a9cbe4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1265 microversion: 2.1 time: 0.092810 Aug 08 02:26:25.701265 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 81/159] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:25 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:25.802625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-adba2036-0724-4e3d-a251-0e332814e360 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:25.803266 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-adba2036-0724-4e3d-a251-0e332814e360 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:25.811434 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-adba2036-0724-4e3d-a251-0e332814e360 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:25.811434 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-adba2036-0724-4e3d-a251-0e332814e360 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:25.811771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-adba2036-0724-4e3d-a251-0e332814e360 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:25.812403 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-adba2036-0724-4e3d-a251-0e332814e360 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:25.812843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-adba2036-0724-4e3d-a251-0e332814e360 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:25.813593 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-adba2036-0724-4e3d-a251-0e332814e360 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:25.835402 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-374631ef-b48e-42c6-b4cc-a021204b7eef tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:25.844487 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-374631ef-b48e-42c6-b4cc-a021204b7eef tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.184508 Aug 08 02:26:25.845548 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 79/160] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:25 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:25.990430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-adba2036-0724-4e3d-a251-0e332814e360 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:25.990430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-adba2036-0724-4e3d-a251-0e332814e360 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.188661 Aug 08 02:26:25.990430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 82/161] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:25 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:26.538920 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2ffc720b-12a5-4c43-8370-91af7c955b86 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:26.540274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2ffc720b-12a5-4c43-8370-91af7c955b86 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:26.547923 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ffc720b-12a5-4c43-8370-91af7c955b86 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:26.548738 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ffc720b-12a5-4c43-8370-91af7c955b86 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:26.549139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ffc720b-12a5-4c43-8370-91af7c955b86 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:26.549847 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ffc720b-12a5-4c43-8370-91af7c955b86 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:26.550325 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ffc720b-12a5-4c43-8370-91af7c955b86 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:26.550731 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ffc720b-12a5-4c43-8370-91af7c955b86 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:26.672358 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-80532431-c0da-4e3e-8a40-d897a0161e73 req-c759b73a-1669-4e90-9495-593f48f46151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61fcac-cea3-4e95-a463-bb2f44b28e39", "name": "network-vif-plugged", "status": "completed", "tag": "f05f2dd7-1c3e-44dc-8f0b-bf42643bdea5"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:26.687222 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2ffc720b-12a5-4c43-8370-91af7c955b86 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:26.692116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-80532431-c0da-4e3e-8a40-d897a0161e73 req-c759b73a-1669-4e90-9495-593f48f46151 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:26.692703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-80532431-c0da-4e3e-8a40-d897a0161e73 req-c759b73a-1669-4e90-9495-593f48f46151 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:26.693145 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-80532431-c0da-4e3e-8a40-d897a0161e73 req-c759b73a-1669-4e90-9495-593f48f46151 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:26.700115 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2ffc720b-12a5-4c43-8370-91af7c955b86 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.166198 Aug 08 02:26:26.700712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 80/162] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:26 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:26.707627 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-91d832bd-1f64-4fed-8582-479dacb7b721 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:26.708238 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-91d832bd-1f64-4fed-8582-479dacb7b721 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:26.711809 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-80532431-c0da-4e3e-8a40-d897a0161e73 req-c759b73a-1669-4e90-9495-593f48f46151 service nova] Creating event network-vif-plugged:f05f2dd7-1c3e-44dc-8f0b-bf42643bdea5 for instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 on hv-cinder-73306 Aug 08 02:26:26.716581 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91d832bd-1f64-4fed-8582-479dacb7b721 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:26.717074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91d832bd-1f64-4fed-8582-479dacb7b721 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:26.717644 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-80532431-c0da-4e3e-8a40-d897a0161e73 req-c759b73a-1669-4e90-9495-593f48f46151 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050832 Aug 08 02:26:26.717769 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91d832bd-1f64-4fed-8582-479dacb7b721 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:26.718236 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 83/163] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:26.718422 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91d832bd-1f64-4fed-8582-479dacb7b721 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:26.719032 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91d832bd-1f64-4fed-8582-479dacb7b721 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:26.719460 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91d832bd-1f64-4fed-8582-479dacb7b721 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:26.726092 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-35eab46e-c308-49e7-9b14-d5dbed98a3bc tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:26.726815 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-35eab46e-c308-49e7-9b14-d5dbed98a3bc tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:26.734447 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-35eab46e-c308-49e7-9b14-d5dbed98a3bc tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:26.734934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-35eab46e-c308-49e7-9b14-d5dbed98a3bc tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:26.735362 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-35eab46e-c308-49e7-9b14-d5dbed98a3bc tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:26.736051 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-35eab46e-c308-49e7-9b14-d5dbed98a3bc tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:26.736717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-35eab46e-c308-49e7-9b14-d5dbed98a3bc tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:26.737293 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-35eab46e-c308-49e7-9b14-d5dbed98a3bc tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:26.804605 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-35eab46e-c308-49e7-9b14-d5dbed98a3bc tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:26.812436 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-35eab46e-c308-49e7-9b14-d5dbed98a3bc tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1265 microversion: 2.1 time: 0.090189 Aug 08 02:26:26.812987 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 84/164] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:26 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:26.854116 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-91d832bd-1f64-4fed-8582-479dacb7b721 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:26.865869 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-91d832bd-1f64-4fed-8582-479dacb7b721 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.163457 Aug 08 02:26:26.866765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 81/165] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:26 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:26.866918 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1a17e434-0e84-4817-8521-0a06a55861dc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:26.867511 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1a17e434-0e84-4817-8521-0a06a55861dc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:26.873532 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a17e434-0e84-4817-8521-0a06a55861dc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:26.874020 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a17e434-0e84-4817-8521-0a06a55861dc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:26.874475 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a17e434-0e84-4817-8521-0a06a55861dc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:26.875157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a17e434-0e84-4817-8521-0a06a55861dc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:26.875603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a17e434-0e84-4817-8521-0a06a55861dc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:26.876022 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a17e434-0e84-4817-8521-0a06a55861dc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:27.005908 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1a17e434-0e84-4817-8521-0a06a55861dc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:27.007290 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dc15590f-2df2-44ec-9287-53a44061f24c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:27.008041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dc15590f-2df2-44ec-9287-53a44061f24c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:27.015223 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc15590f-2df2-44ec-9287-53a44061f24c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:27.015392 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1a17e434-0e84-4817-8521-0a06a55861dc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.152159 Aug 08 02:26:27.015852 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc15590f-2df2-44ec-9287-53a44061f24c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:27.018301 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc15590f-2df2-44ec-9287-53a44061f24c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:27.018470 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 85/166] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:26 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:27.018555 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc15590f-2df2-44ec-9287-53a44061f24c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:27.018555 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc15590f-2df2-44ec-9287-53a44061f24c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:27.018555 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc15590f-2df2-44ec-9287-53a44061f24c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:27.146794 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dc15590f-2df2-44ec-9287-53a44061f24c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:27.155971 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dc15590f-2df2-44ec-9287-53a44061f24c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.152791 Aug 08 02:26:27.156746 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 82/167] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:27 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:27.723018 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ca2516d8-baaf-4a05-a45a-753f053aa730 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:27.723820 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ca2516d8-baaf-4a05-a45a-753f053aa730 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:27.729645 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ca2516d8-baaf-4a05-a45a-753f053aa730 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:27.730642 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ca2516d8-baaf-4a05-a45a-753f053aa730 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:27.731065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ca2516d8-baaf-4a05-a45a-753f053aa730 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:27.731740 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ca2516d8-baaf-4a05-a45a-753f053aa730 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:27.732180 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ca2516d8-baaf-4a05-a45a-753f053aa730 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:27.732592 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ca2516d8-baaf-4a05-a45a-753f053aa730 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:27.833304 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ca966534-c5a1-4832-9b18-0fcfa7275f13 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:27.834000 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ca966534-c5a1-4832-9b18-0fcfa7275f13 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:27.840296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca966534-c5a1-4832-9b18-0fcfa7275f13 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:27.840980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca966534-c5a1-4832-9b18-0fcfa7275f13 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:27.841409 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca966534-c5a1-4832-9b18-0fcfa7275f13 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:27.842097 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca966534-c5a1-4832-9b18-0fcfa7275f13 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:27.842741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca966534-c5a1-4832-9b18-0fcfa7275f13 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:27.843161 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca966534-c5a1-4832-9b18-0fcfa7275f13 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:27.884876 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ca2516d8-baaf-4a05-a45a-753f053aa730 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:27.892995 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ca2516d8-baaf-4a05-a45a-753f053aa730 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.173784 Aug 08 02:26:27.893567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 86/168] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:27 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:27.906620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-92d32b94-aab5-4201-b66a-df5c025745da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:27.907363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-92d32b94-aab5-4201-b66a-df5c025745da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:27.913349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92d32b94-aab5-4201-b66a-df5c025745da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:27.913832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92d32b94-aab5-4201-b66a-df5c025745da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:27.914275 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92d32b94-aab5-4201-b66a-df5c025745da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:27.914968 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92d32b94-aab5-4201-b66a-df5c025745da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:27.915422 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92d32b94-aab5-4201-b66a-df5c025745da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:27.915844 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92d32b94-aab5-4201-b66a-df5c025745da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:27.928623 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ca966534-c5a1-4832-9b18-0fcfa7275f13 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:27.937454 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ca966534-c5a1-4832-9b18-0fcfa7275f13 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1265 microversion: 2.1 time: 0.108209 Aug 08 02:26:27.938152 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 83/169] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:27 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:28.037004 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-60dc42db-8b2a-4c6c-a085-c20f0f734599 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:28.037942 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-60dc42db-8b2a-4c6c-a085-c20f0f734599 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:28.044438 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60dc42db-8b2a-4c6c-a085-c20f0f734599 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:28.044911 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60dc42db-8b2a-4c6c-a085-c20f0f734599 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:28.045330 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60dc42db-8b2a-4c6c-a085-c20f0f734599 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:28.046169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60dc42db-8b2a-4c6c-a085-c20f0f734599 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:28.046796 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60dc42db-8b2a-4c6c-a085-c20f0f734599 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:28.047212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60dc42db-8b2a-4c6c-a085-c20f0f734599 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:28.054655 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-92d32b94-aab5-4201-b66a-df5c025745da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:28.065339 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-92d32b94-aab5-4201-b66a-df5c025745da tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.162397 Aug 08 02:26:28.066117 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 87/170] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:27 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:28.176819 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2d6839f2-dd82-42db-af22-d00259ee617b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:28.177921 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2d6839f2-dd82-42db-af22-d00259ee617b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:28.184138 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2d6839f2-dd82-42db-af22-d00259ee617b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:28.184693 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2d6839f2-dd82-42db-af22-d00259ee617b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:28.185332 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2d6839f2-dd82-42db-af22-d00259ee617b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:28.186222 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2d6839f2-dd82-42db-af22-d00259ee617b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:28.186697 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2d6839f2-dd82-42db-af22-d00259ee617b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:28.187261 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2d6839f2-dd82-42db-af22-d00259ee617b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:28.216914 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-60dc42db-8b2a-4c6c-a085-c20f0f734599 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:28.224547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-60dc42db-8b2a-4c6c-a085-c20f0f734599 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.191551 Aug 08 02:26:28.225125 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 84/171] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:28 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:28.395215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2d6839f2-dd82-42db-af22-d00259ee617b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:28.404290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2d6839f2-dd82-42db-af22-d00259ee617b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.231199 Aug 08 02:26:28.404980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 88/172] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:28 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:28.912870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e0ff774c-d965-4389-9af6-8cc7f403008d tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:28.913487 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e0ff774c-d965-4389-9af6-8cc7f403008d tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:28.919504 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0ff774c-d965-4389-9af6-8cc7f403008d tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:28.920024 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0ff774c-d965-4389-9af6-8cc7f403008d tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:28.920462 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0ff774c-d965-4389-9af6-8cc7f403008d tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:28.921150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0ff774c-d965-4389-9af6-8cc7f403008d tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:28.921605 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0ff774c-d965-4389-9af6-8cc7f403008d tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:28.922086 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0ff774c-d965-4389-9af6-8cc7f403008d tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:28.958150 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-63de39e4-946a-4851-abcc-56e8715599c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:28.958942 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-63de39e4-946a-4851-abcc-56e8715599c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:28.966962 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-63de39e4-946a-4851-abcc-56e8715599c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:28.967447 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-63de39e4-946a-4851-abcc-56e8715599c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:28.967878 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-63de39e4-946a-4851-abcc-56e8715599c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:28.968576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-63de39e4-946a-4851-abcc-56e8715599c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:28.969023 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-63de39e4-946a-4851-abcc-56e8715599c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:28.969443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-63de39e4-946a-4851-abcc-56e8715599c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:29.040681 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-63de39e4-946a-4851-abcc-56e8715599c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:29.050820 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-63de39e4-946a-4851-abcc-56e8715599c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1265 microversion: 2.1 time: 0.096151 Aug 08 02:26:29.052222 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 89/173] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:28 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:29.056809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e0ff774c-d965-4389-9af6-8cc7f403008d tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:29.065172 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e0ff774c-d965-4389-9af6-8cc7f403008d tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.156260 Aug 08 02:26:29.065942 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 85/174] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:28 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:29.085965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e832b786-5d47-4d4b-951a-949eb73fc32a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:29.086869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e832b786-5d47-4d4b-951a-949eb73fc32a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:29.093178 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e832b786-5d47-4d4b-951a-949eb73fc32a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:29.093725 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e832b786-5d47-4d4b-951a-949eb73fc32a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:29.094188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e832b786-5d47-4d4b-951a-949eb73fc32a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:29.094889 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e832b786-5d47-4d4b-951a-949eb73fc32a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:29.095332 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e832b786-5d47-4d4b-951a-949eb73fc32a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:29.095750 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e832b786-5d47-4d4b-951a-949eb73fc32a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:29.238595 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e832b786-5d47-4d4b-951a-949eb73fc32a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:29.245222 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7570b974-75de-4193-b850-0d7009bedcca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:29.246453 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7570b974-75de-4193-b850-0d7009bedcca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:29.246852 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e832b786-5d47-4d4b-951a-949eb73fc32a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.164525 Aug 08 02:26:29.247709 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 90/175] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:29 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:29.252863 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7570b974-75de-4193-b850-0d7009bedcca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:29.253341 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7570b974-75de-4193-b850-0d7009bedcca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:29.253774 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7570b974-75de-4193-b850-0d7009bedcca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:29.254488 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7570b974-75de-4193-b850-0d7009bedcca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:29.254940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7570b974-75de-4193-b850-0d7009bedcca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:29.255357 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7570b974-75de-4193-b850-0d7009bedcca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:29.404383 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7570b974-75de-4193-b850-0d7009bedcca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:29.411785 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7570b974-75de-4193-b850-0d7009bedcca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.170318 Aug 08 02:26:29.425506 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 86/176] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:29 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:29.426624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-23575e84-043a-4619-b2b7-cba1b3c95011 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:29.427301 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-23575e84-043a-4619-b2b7-cba1b3c95011 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:29.433782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-23575e84-043a-4619-b2b7-cba1b3c95011 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:29.434387 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-23575e84-043a-4619-b2b7-cba1b3c95011 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:29.434705 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-23575e84-043a-4619-b2b7-cba1b3c95011 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:29.435383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-23575e84-043a-4619-b2b7-cba1b3c95011 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:29.435828 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-23575e84-043a-4619-b2b7-cba1b3c95011 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:29.436243 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-23575e84-043a-4619-b2b7-cba1b3c95011 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:29.785007 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-23575e84-043a-4619-b2b7-cba1b3c95011 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:29.796491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-23575e84-043a-4619-b2b7-cba1b3c95011 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.373935 Aug 08 02:26:29.797020 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 91/177] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:29 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:30.072955 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eeaa4d59-43f8-429b-a466-8bc89901d18a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:30.074123 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eeaa4d59-43f8-429b-a466-8bc89901d18a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:30.081484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eeaa4d59-43f8-429b-a466-8bc89901d18a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:30.082052 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eeaa4d59-43f8-429b-a466-8bc89901d18a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:30.082578 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eeaa4d59-43f8-429b-a466-8bc89901d18a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:30.083333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eeaa4d59-43f8-429b-a466-8bc89901d18a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:30.084019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eeaa4d59-43f8-429b-a466-8bc89901d18a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:30.084504 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eeaa4d59-43f8-429b-a466-8bc89901d18a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:30.087074 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8234211e-6e2d-409b-89ff-a1e95f0a5299 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:30.087736 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8234211e-6e2d-409b-89ff-a1e95f0a5299 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:30.094108 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8234211e-6e2d-409b-89ff-a1e95f0a5299 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:30.094730 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8234211e-6e2d-409b-89ff-a1e95f0a5299 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:30.095161 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8234211e-6e2d-409b-89ff-a1e95f0a5299 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:30.095850 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8234211e-6e2d-409b-89ff-a1e95f0a5299 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:30.096287 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8234211e-6e2d-409b-89ff-a1e95f0a5299 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:30.096964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8234211e-6e2d-409b-89ff-a1e95f0a5299 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:30.150610 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eeaa4d59-43f8-429b-a466-8bc89901d18a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:30.161997 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eeaa4d59-43f8-429b-a466-8bc89901d18a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1265 microversion: 2.1 time: 0.092882 Aug 08 02:26:30.162866 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 87/178] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:30 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:30.238040 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8234211e-6e2d-409b-89ff-a1e95f0a5299 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:30.246035 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8234211e-6e2d-409b-89ff-a1e95f0a5299 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.162786 Aug 08 02:26:30.246638 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 92/179] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:30 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:30.267877 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-06e9ebfe-c772-4d7a-ad2d-fb7e2212b140 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:30.268487 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-06e9ebfe-c772-4d7a-ad2d-fb7e2212b140 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:30.274442 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06e9ebfe-c772-4d7a-ad2d-fb7e2212b140 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:30.274923 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06e9ebfe-c772-4d7a-ad2d-fb7e2212b140 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:30.275353 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06e9ebfe-c772-4d7a-ad2d-fb7e2212b140 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:30.276035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06e9ebfe-c772-4d7a-ad2d-fb7e2212b140 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:30.276485 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06e9ebfe-c772-4d7a-ad2d-fb7e2212b140 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:30.277564 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06e9ebfe-c772-4d7a-ad2d-fb7e2212b140 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:30.416313 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-06e9ebfe-c772-4d7a-ad2d-fb7e2212b140 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:30.425465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-06e9ebfe-c772-4d7a-ad2d-fb7e2212b140 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.161347 Aug 08 02:26:30.426026 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 88/180] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:30 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:30.433608 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6a328b22-13d3-4ed8-ba9b-cbade3b233c6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:30.434227 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6a328b22-13d3-4ed8-ba9b-cbade3b233c6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:30.440711 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6a328b22-13d3-4ed8-ba9b-cbade3b233c6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:30.441197 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6a328b22-13d3-4ed8-ba9b-cbade3b233c6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:30.441629 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6a328b22-13d3-4ed8-ba9b-cbade3b233c6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:30.442408 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6a328b22-13d3-4ed8-ba9b-cbade3b233c6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:30.442802 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6a328b22-13d3-4ed8-ba9b-cbade3b233c6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:30.443222 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6a328b22-13d3-4ed8-ba9b-cbade3b233c6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:30.580828 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6a328b22-13d3-4ed8-ba9b-cbade3b233c6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:30.588254 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6a328b22-13d3-4ed8-ba9b-cbade3b233c6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.159167 Aug 08 02:26:30.588821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 93/181] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:30 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:30.817095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ab6dd58c-092b-403d-9480-ec7fd7f65633 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:30.817704 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ab6dd58c-092b-403d-9480-ec7fd7f65633 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:30.823587 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab6dd58c-092b-403d-9480-ec7fd7f65633 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:30.824248 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab6dd58c-092b-403d-9480-ec7fd7f65633 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:30.824672 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab6dd58c-092b-403d-9480-ec7fd7f65633 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:30.825351 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab6dd58c-092b-403d-9480-ec7fd7f65633 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:30.825793 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab6dd58c-092b-403d-9480-ec7fd7f65633 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:30.826204 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab6dd58c-092b-403d-9480-ec7fd7f65633 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:30.959118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ab6dd58c-092b-403d-9480-ec7fd7f65633 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:30.967030 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ab6dd58c-092b-403d-9480-ec7fd7f65633 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.153997 Aug 08 02:26:30.967691 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 89/182] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:30 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:31.181500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-efd8c3a6-2c6d-40a8-843f-827a1f93c102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:31.182110 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-efd8c3a6-2c6d-40a8-843f-827a1f93c102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:31.188077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-efd8c3a6-2c6d-40a8-843f-827a1f93c102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:31.188557 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-efd8c3a6-2c6d-40a8-843f-827a1f93c102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:31.188994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-efd8c3a6-2c6d-40a8-843f-827a1f93c102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:31.189924 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-efd8c3a6-2c6d-40a8-843f-827a1f93c102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:31.190413 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-efd8c3a6-2c6d-40a8-843f-827a1f93c102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:31.190832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-efd8c3a6-2c6d-40a8-843f-827a1f93c102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:31.252362 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-efd8c3a6-2c6d-40a8-843f-827a1f93c102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:31.259716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-efd8c3a6-2c6d-40a8-843f-827a1f93c102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1265 microversion: 2.1 time: 0.082047 Aug 08 02:26:31.260281 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 94/183] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:31 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:31.265970 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d091a2ee-78d9-47dd-a3e4-10d856e8d82a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:31.266607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d091a2ee-78d9-47dd-a3e4-10d856e8d82a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:31.272390 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d091a2ee-78d9-47dd-a3e4-10d856e8d82a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:31.272862 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d091a2ee-78d9-47dd-a3e4-10d856e8d82a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:31.273286 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d091a2ee-78d9-47dd-a3e4-10d856e8d82a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:31.273955 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d091a2ee-78d9-47dd-a3e4-10d856e8d82a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:31.274425 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d091a2ee-78d9-47dd-a3e4-10d856e8d82a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:31.274841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d091a2ee-78d9-47dd-a3e4-10d856e8d82a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:31.410364 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d091a2ee-78d9-47dd-a3e4-10d856e8d82a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:31.418467 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d091a2ee-78d9-47dd-a3e4-10d856e8d82a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.156201 Aug 08 02:26:31.419043 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 90/184] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:31 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:31.446153 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0ec744f7-9654-4ad3-acb7-6951da716d07 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:31.446893 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0ec744f7-9654-4ad3-acb7-6951da716d07 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:31.453328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ec744f7-9654-4ad3-acb7-6951da716d07 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:31.453824 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ec744f7-9654-4ad3-acb7-6951da716d07 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:31.454275 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ec744f7-9654-4ad3-acb7-6951da716d07 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:31.454948 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ec744f7-9654-4ad3-acb7-6951da716d07 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:31.455392 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ec744f7-9654-4ad3-acb7-6951da716d07 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:31.455804 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ec744f7-9654-4ad3-acb7-6951da716d07 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:31.582896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0ec744f7-9654-4ad3-acb7-6951da716d07 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:31.590941 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0ec744f7-9654-4ad3-acb7-6951da716d07 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.148699 Aug 08 02:26:31.591489 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 95/185] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:31 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:31.608914 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e970e4b1-7d55-4def-8d85-68eb6bb39c4d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:31.609528 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e970e4b1-7d55-4def-8d85-68eb6bb39c4d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:31.615314 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e970e4b1-7d55-4def-8d85-68eb6bb39c4d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:31.615796 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e970e4b1-7d55-4def-8d85-68eb6bb39c4d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:31.616228 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e970e4b1-7d55-4def-8d85-68eb6bb39c4d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:31.616912 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e970e4b1-7d55-4def-8d85-68eb6bb39c4d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:31.617363 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e970e4b1-7d55-4def-8d85-68eb6bb39c4d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:31.617786 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e970e4b1-7d55-4def-8d85-68eb6bb39c4d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:31.745682 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e970e4b1-7d55-4def-8d85-68eb6bb39c4d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:31.753131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e970e4b1-7d55-4def-8d85-68eb6bb39c4d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.148147 Aug 08 02:26:31.753857 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 91/186] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:31 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:31.988649 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4ea5c2ae-4376-4593-aa3d-b7792259b55d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:31.989259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4ea5c2ae-4376-4593-aa3d-b7792259b55d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:31.991269 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:31.996878 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ea5c2ae-4376-4593-aa3d-b7792259b55d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:31.997358 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ea5c2ae-4376-4593-aa3d-b7792259b55d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:31.997791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ea5c2ae-4376-4593-aa3d-b7792259b55d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:31.998504 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ea5c2ae-4376-4593-aa3d-b7792259b55d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:31.998964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ea5c2ae-4376-4593-aa3d-b7792259b55d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:31.999387 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ea5c2ae-4376-4593-aa3d-b7792259b55d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:32.133595 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4ea5c2ae-4376-4593-aa3d-b7792259b55d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:32.141600 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4ea5c2ae-4376-4593-aa3d-b7792259b55d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1322 microversion: 2.1 time: 0.156819 Aug 08 02:26:32.142169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 96/187] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:31 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:32.280406 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d7ccf805-745a-4f9c-bea8-a664b6709fd7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:32.281022 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d7ccf805-745a-4f9c-bea8-a664b6709fd7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:32.287213 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7ccf805-745a-4f9c-bea8-a664b6709fd7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:32.287837 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7ccf805-745a-4f9c-bea8-a664b6709fd7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:32.288279 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7ccf805-745a-4f9c-bea8-a664b6709fd7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:32.288974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7ccf805-745a-4f9c-bea8-a664b6709fd7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:32.289428 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7ccf805-745a-4f9c-bea8-a664b6709fd7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:32.289850 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7ccf805-745a-4f9c-bea8-a664b6709fd7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:32.295318 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:32.354148 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d7ccf805-745a-4f9c-bea8-a664b6709fd7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:32.362152 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d7ccf805-745a-4f9c-bea8-a664b6709fd7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1265 microversion: 2.1 time: 0.085602 Aug 08 02:26:32.362778 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 92/188] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:32 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:32.426040 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-f7af3c4f-f2d7-4d88-a72c-5ad4f6f29495 req-3db0bbd1-5a70-449b-b292-74fac24daca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4568714-ae5a-47eb-9140-be5702dd288e", "name": "network-vif-plugged", "status": "completed", "tag": "64cd5cbd-515d-4839-a3a7-ee52df20970a"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:32.436972 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-f7af3c4f-f2d7-4d88-a72c-5ad4f6f29495 req-3db0bbd1-5a70-449b-b292-74fac24daca1 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:32.437445 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-f7af3c4f-f2d7-4d88-a72c-5ad4f6f29495 req-3db0bbd1-5a70-449b-b292-74fac24daca1 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:32.437875 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-f7af3c4f-f2d7-4d88-a72c-5ad4f6f29495 req-3db0bbd1-5a70-449b-b292-74fac24daca1 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:32.438784 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d208d6c9-e308-48d4-a7bf-f3c394388c65 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:32.440370 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d208d6c9-e308-48d4-a7bf-f3c394388c65 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:32.447644 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d208d6c9-e308-48d4-a7bf-f3c394388c65 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:32.449292 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d208d6c9-e308-48d4-a7bf-f3c394388c65 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:32.450037 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d208d6c9-e308-48d4-a7bf-f3c394388c65 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:32.450589 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-f7af3c4f-f2d7-4d88-a72c-5ad4f6f29495 req-3db0bbd1-5a70-449b-b292-74fac24daca1 service nova] Creating event network-vif-plugged:64cd5cbd-515d-4839-a3a7-ee52df20970a for instance b4568714-ae5a-47eb-9140-be5702dd288e on hv-cinder-73306 Aug 08 02:26:32.451202 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d208d6c9-e308-48d4-a7bf-f3c394388c65 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:32.451867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d208d6c9-e308-48d4-a7bf-f3c394388c65 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:32.452497 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d208d6c9-e308-48d4-a7bf-f3c394388c65 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:32.455819 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-f7af3c4f-f2d7-4d88-a72c-5ad4f6f29495 req-3db0bbd1-5a70-449b-b292-74fac24daca1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033483 Aug 08 02:26:32.456626 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 97/189] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:32.600585 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d208d6c9-e308-48d4-a7bf-f3c394388c65 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:32.608985 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d208d6c9-e308-48d4-a7bf-f3c394388c65 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.173935 Aug 08 02:26:32.609484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 93/190] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:32 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:32.612380 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-728c80f5-cad6-43ab-adc8-73388a6a3f44 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:32.613079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-728c80f5-cad6-43ab-adc8-73388a6a3f44 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:32.619254 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-728c80f5-cad6-43ab-adc8-73388a6a3f44 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:32.619726 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-728c80f5-cad6-43ab-adc8-73388a6a3f44 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:32.620153 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-728c80f5-cad6-43ab-adc8-73388a6a3f44 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:32.620831 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-728c80f5-cad6-43ab-adc8-73388a6a3f44 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:32.621279 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-728c80f5-cad6-43ab-adc8-73388a6a3f44 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:32.621698 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-728c80f5-cad6-43ab-adc8-73388a6a3f44 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:32.749157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-728c80f5-cad6-43ab-adc8-73388a6a3f44 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:32.756702 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-728c80f5-cad6-43ab-adc8-73388a6a3f44 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.148505 Aug 08 02:26:32.757266 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 98/191] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:32 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:32.774054 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-207eacea-2695-4159-92a6-1b781fefe39a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:32.774684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-207eacea-2695-4159-92a6-1b781fefe39a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:32.780996 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-207eacea-2695-4159-92a6-1b781fefe39a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:32.781461 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-207eacea-2695-4159-92a6-1b781fefe39a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:32.781883 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-207eacea-2695-4159-92a6-1b781fefe39a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:32.782591 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-207eacea-2695-4159-92a6-1b781fefe39a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:32.783031 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-207eacea-2695-4159-92a6-1b781fefe39a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:32.783441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-207eacea-2695-4159-92a6-1b781fefe39a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:32.913789 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-207eacea-2695-4159-92a6-1b781fefe39a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:32.922413 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-207eacea-2695-4159-92a6-1b781fefe39a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.152080 Aug 08 02:26:32.922997 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 94/192] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:32 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:33.167996 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-57779761-2179-404e-af3f-3cb1a939e06c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:33.168843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-57779761-2179-404e-af3f-3cb1a939e06c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:33.176881 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57779761-2179-404e-af3f-3cb1a939e06c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.177416 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57779761-2179-404e-af3f-3cb1a939e06c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.177850 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57779761-2179-404e-af3f-3cb1a939e06c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.178593 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57779761-2179-404e-af3f-3cb1a939e06c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.179501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57779761-2179-404e-af3f-3cb1a939e06c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.179501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57779761-2179-404e-af3f-3cb1a939e06c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.330718 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-57779761-2179-404e-af3f-3cb1a939e06c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:33.334425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:33.341376 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-57779761-2179-404e-af3f-3cb1a939e06c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1517 microversion: 2.1 time: 0.179095 Aug 08 02:26:33.342290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 99/193] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:33 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:33.369740 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a18b43f1-cc36-41be-a2c3-e806c6ecad1c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:33.374360 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a18b43f1-cc36-41be-a2c3-e806c6ecad1c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:33.385571 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:33.386340 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:33.388072 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e29a9197-6202-4776-9143-641a867eb622 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:33.388698 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e29a9197-6202-4776-9143-641a867eb622 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:33.393380 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a18b43f1-cc36-41be-a2c3-e806c6ecad1c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.393713 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a18b43f1-cc36-41be-a2c3-e806c6ecad1c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.394163 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a18b43f1-cc36-41be-a2c3-e806c6ecad1c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.394928 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a18b43f1-cc36-41be-a2c3-e806c6ecad1c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.395370 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a18b43f1-cc36-41be-a2c3-e806c6ecad1c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.396028 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:33.397306 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a18b43f1-cc36-41be-a2c3-e806c6ecad1c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.406473 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e29a9197-6202-4776-9143-641a867eb622 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.406952 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e29a9197-6202-4776-9143-641a867eb622 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.407383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e29a9197-6202-4776-9143-641a867eb622 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.408086 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e29a9197-6202-4776-9143-641a867eb622 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.408536 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e29a9197-6202-4776-9143-641a867eb622 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.408958 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e29a9197-6202-4776-9143-641a867eb622 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.476242 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-a18b43f1-cc36-41be-a2c3-e806c6ecad1c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lazy-loading 'flavor' on Instance uuid 13364414-05f0-413b-bd7e-27ad8c210e32 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:26:33.512259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e29a9197-6202-4776-9143-641a867eb622 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:33.522155 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e29a9197-6202-4776-9143-641a867eb622 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1273 microversion: 2.1 time: 0.142606 Aug 08 02:26:33.524780 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 100/194] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:33 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1273 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:33.613574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a18b43f1-cc36-41be-a2c3-e806c6ecad1c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "POST /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32/action" status: 200 len: 32 microversion: 2.1 time: 0.251975 Aug 08 02:26:33.614917 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 95/195] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:26:33 2022] POST /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 02:26:33.626817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dfaaa855-daa2-4a88-9aa9-75e6f512956d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:33.627910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-dfaaa855-daa2-4a88-9aa9-75e6f512956d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:33.637568 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfaaa855-daa2-4a88-9aa9-75e6f512956d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.638416 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfaaa855-daa2-4a88-9aa9-75e6f512956d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.639070 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfaaa855-daa2-4a88-9aa9-75e6f512956d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.640312 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfaaa855-daa2-4a88-9aa9-75e6f512956d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.641250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfaaa855-daa2-4a88-9aa9-75e6f512956d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.641970 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-78cf26ff-e5a6-462b-8483-dec9c5b94077 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:33.642405 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfaaa855-daa2-4a88-9aa9-75e6f512956d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.642734 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-78cf26ff-e5a6-462b-8483-dec9c5b94077 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:33.668586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78cf26ff-e5a6-462b-8483-dec9c5b94077 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.669085 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78cf26ff-e5a6-462b-8483-dec9c5b94077 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.669517 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78cf26ff-e5a6-462b-8483-dec9c5b94077 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.670240 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78cf26ff-e5a6-462b-8483-dec9c5b94077 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.670681 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78cf26ff-e5a6-462b-8483-dec9c5b94077 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.671097 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78cf26ff-e5a6-462b-8483-dec9c5b94077 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.829724 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-dfaaa855-daa2-4a88-9aa9-75e6f512956d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:33.837281 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-dfaaa855-daa2-4a88-9aa9-75e6f512956d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.216467 Aug 08 02:26:33.837855 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 101/196] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:33 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:33.843061 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-90521505-0a43-469c-8ae7-c5dcb703af48 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:33.843971 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-90521505-0a43-469c-8ae7-c5dcb703af48 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:33.849689 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-90521505-0a43-469c-8ae7-c5dcb703af48 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.850402 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-90521505-0a43-469c-8ae7-c5dcb703af48 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.850989 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-90521505-0a43-469c-8ae7-c5dcb703af48 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.852002 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-90521505-0a43-469c-8ae7-c5dcb703af48 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.852462 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-90521505-0a43-469c-8ae7-c5dcb703af48 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.853039 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-90521505-0a43-469c-8ae7-c5dcb703af48 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.856298 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-78cf26ff-e5a6-462b-8483-dec9c5b94077 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:33.864089 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-78cf26ff-e5a6-462b-8483-dec9c5b94077 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.236501 Aug 08 02:26:33.864907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 96/197] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:33 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:33.943755 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b55b306f-028e-42b1-a28a-55ff405b91de tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:33.944620 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b55b306f-028e-42b1-a28a-55ff405b91de tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:33.951506 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b55b306f-028e-42b1-a28a-55ff405b91de tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.952067 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b55b306f-028e-42b1-a28a-55ff405b91de tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.952567 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b55b306f-028e-42b1-a28a-55ff405b91de tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:33.953328 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b55b306f-028e-42b1-a28a-55ff405b91de tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:33.954035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b55b306f-028e-42b1-a28a-55ff405b91de tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:33.954766 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b55b306f-028e-42b1-a28a-55ff405b91de tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:34.001850 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-90521505-0a43-469c-8ae7-c5dcb703af48 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:34.009409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-90521505-0a43-469c-8ae7-c5dcb703af48 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.170367 Aug 08 02:26:34.021215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 102/198] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:33 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:34.089562 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b55b306f-028e-42b1-a28a-55ff405b91de tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:34.097360 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b55b306f-028e-42b1-a28a-55ff405b91de tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.157423 Aug 08 02:26:34.098139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 97/199] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:33 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:34.546673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c46990c9-8490-4b85-84b3-2ba7e79d8a5a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:34.547291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c46990c9-8490-4b85-84b3-2ba7e79d8a5a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:34.554333 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c46990c9-8490-4b85-84b3-2ba7e79d8a5a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:34.554815 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c46990c9-8490-4b85-84b3-2ba7e79d8a5a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:34.555237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c46990c9-8490-4b85-84b3-2ba7e79d8a5a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:34.555920 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c46990c9-8490-4b85-84b3-2ba7e79d8a5a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:34.556366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c46990c9-8490-4b85-84b3-2ba7e79d8a5a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:34.556784 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c46990c9-8490-4b85-84b3-2ba7e79d8a5a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:34.624131 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c46990c9-8490-4b85-84b3-2ba7e79d8a5a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:34.631824 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c46990c9-8490-4b85-84b3-2ba7e79d8a5a tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1273 microversion: 2.1 time: 0.090398 Aug 08 02:26:34.632394 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 103/200] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:34 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:34.859331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0bb889be-db3d-4b09-a0eb-b329a60ecc64 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:34.860060 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0bb889be-db3d-4b09-a0eb-b329a60ecc64 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:34.866195 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bb889be-db3d-4b09-a0eb-b329a60ecc64 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:34.866811 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bb889be-db3d-4b09-a0eb-b329a60ecc64 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:34.867309 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bb889be-db3d-4b09-a0eb-b329a60ecc64 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:34.868078 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bb889be-db3d-4b09-a0eb-b329a60ecc64 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:34.868598 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bb889be-db3d-4b09-a0eb-b329a60ecc64 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:34.869087 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bb889be-db3d-4b09-a0eb-b329a60ecc64 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:34.885370 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0279f838-9f7d-42db-81d0-8a0020cfecf5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:34.885977 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0279f838-9f7d-42db-81d0-8a0020cfecf5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:34.892299 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0279f838-9f7d-42db-81d0-8a0020cfecf5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:34.892775 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0279f838-9f7d-42db-81d0-8a0020cfecf5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:34.893362 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0279f838-9f7d-42db-81d0-8a0020cfecf5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:34.894051 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0279f838-9f7d-42db-81d0-8a0020cfecf5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:34.894517 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0279f838-9f7d-42db-81d0-8a0020cfecf5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:34.895237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0279f838-9f7d-42db-81d0-8a0020cfecf5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:35.039711 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0279f838-9f7d-42db-81d0-8a0020cfecf5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:35.049142 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0279f838-9f7d-42db-81d0-8a0020cfecf5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.167927 Aug 08 02:26:35.049836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 104/201] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:34 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:35.054772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6a441452-c00f-458e-8585-3a2dbbdc6b4a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:35.055449 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6a441452-c00f-458e-8585-3a2dbbdc6b4a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:35.061585 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6a441452-c00f-458e-8585-3a2dbbdc6b4a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:35.062227 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6a441452-c00f-458e-8585-3a2dbbdc6b4a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:35.063191 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6a441452-c00f-458e-8585-3a2dbbdc6b4a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:35.064657 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6a441452-c00f-458e-8585-3a2dbbdc6b4a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:35.064787 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0bb889be-db3d-4b09-a0eb-b329a60ecc64 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:35.065324 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6a441452-c00f-458e-8585-3a2dbbdc6b4a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:35.066108 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6a441452-c00f-458e-8585-3a2dbbdc6b4a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:35.072529 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0bb889be-db3d-4b09-a0eb-b329a60ecc64 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.217607 Aug 08 02:26:35.073538 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 98/202] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:34 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:35.117907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-206e04e7-5e0e-48e3-843b-90c82d44a509 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:35.118550 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-206e04e7-5e0e-48e3-843b-90c82d44a509 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:35.124630 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-206e04e7-5e0e-48e3-843b-90c82d44a509 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:35.125164 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-206e04e7-5e0e-48e3-843b-90c82d44a509 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:35.125595 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-206e04e7-5e0e-48e3-843b-90c82d44a509 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:35.126295 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-206e04e7-5e0e-48e3-843b-90c82d44a509 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:35.126741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-206e04e7-5e0e-48e3-843b-90c82d44a509 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:35.127153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-206e04e7-5e0e-48e3-843b-90c82d44a509 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:35.213773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6a441452-c00f-458e-8585-3a2dbbdc6b4a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:35.223122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6a441452-c00f-458e-8585-3a2dbbdc6b4a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.171900 Aug 08 02:26:35.223692 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 105/203] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:35 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:35.264611 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-206e04e7-5e0e-48e3-843b-90c82d44a509 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:35.272639 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-206e04e7-5e0e-48e3-843b-90c82d44a509 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.158028 Aug 08 02:26:35.273219 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 99/204] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:35 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:35.651516 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2145b155-cb2d-4e0a-8a8c-278115544ff9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:35.652298 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2145b155-cb2d-4e0a-8a8c-278115544ff9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:35.658832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2145b155-cb2d-4e0a-8a8c-278115544ff9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:35.659317 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2145b155-cb2d-4e0a-8a8c-278115544ff9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:35.659746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2145b155-cb2d-4e0a-8a8c-278115544ff9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:35.660429 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2145b155-cb2d-4e0a-8a8c-278115544ff9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:35.660871 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2145b155-cb2d-4e0a-8a8c-278115544ff9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:35.661529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2145b155-cb2d-4e0a-8a8c-278115544ff9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:35.722840 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2145b155-cb2d-4e0a-8a8c-278115544ff9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:35.730103 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2145b155-cb2d-4e0a-8a8c-278115544ff9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1273 microversion: 2.1 time: 0.082370 Aug 08 02:26:35.730711 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 106/205] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:35 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:36.069255 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cb2c4dec-f509-4467-b4f5-2a52bb2eba1e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:36.069875 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cb2c4dec-f509-4467-b4f5-2a52bb2eba1e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:36.075762 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb2c4dec-f509-4467-b4f5-2a52bb2eba1e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:36.076245 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb2c4dec-f509-4467-b4f5-2a52bb2eba1e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:36.076681 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb2c4dec-f509-4467-b4f5-2a52bb2eba1e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:36.077367 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb2c4dec-f509-4467-b4f5-2a52bb2eba1e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:36.077821 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb2c4dec-f509-4467-b4f5-2a52bb2eba1e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:36.078260 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb2c4dec-f509-4467-b4f5-2a52bb2eba1e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:36.094299 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7efd9a7c-1473-4771-90e8-b9798af02843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:36.094919 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7efd9a7c-1473-4771-90e8-b9798af02843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:36.100746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7efd9a7c-1473-4771-90e8-b9798af02843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:36.101227 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7efd9a7c-1473-4771-90e8-b9798af02843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:36.101663 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7efd9a7c-1473-4771-90e8-b9798af02843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:36.102385 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7efd9a7c-1473-4771-90e8-b9798af02843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:36.102842 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7efd9a7c-1473-4771-90e8-b9798af02843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:36.103264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7efd9a7c-1473-4771-90e8-b9798af02843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:36.214488 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cb2c4dec-f509-4467-b4f5-2a52bb2eba1e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:36.222017 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cb2c4dec-f509-4467-b4f5-2a52bb2eba1e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.156530 Aug 08 02:26:36.222619 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 100/206] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:36 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:36.238874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7efd9a7c-1473-4771-90e8-b9798af02843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:36.243621 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f24a7e66-2b4b-4082-949d-fafc5c655821 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:36.244241 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f24a7e66-2b4b-4082-949d-fafc5c655821 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:36.247138 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7efd9a7c-1473-4771-90e8-b9798af02843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.156885 Aug 08 02:26:36.247697 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 107/207] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:36 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:36.251093 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f24a7e66-2b4b-4082-949d-fafc5c655821 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:36.251574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f24a7e66-2b4b-4082-949d-fafc5c655821 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:36.252009 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f24a7e66-2b4b-4082-949d-fafc5c655821 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:36.252696 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f24a7e66-2b4b-4082-949d-fafc5c655821 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:36.253148 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f24a7e66-2b4b-4082-949d-fafc5c655821 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:36.253570 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f24a7e66-2b4b-4082-949d-fafc5c655821 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:36.296390 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1ed609a9-71ea-4425-90f8-b18d80a88ffc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:36.297323 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1ed609a9-71ea-4425-90f8-b18d80a88ffc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:36.303743 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1ed609a9-71ea-4425-90f8-b18d80a88ffc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:36.304288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1ed609a9-71ea-4425-90f8-b18d80a88ffc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:36.304785 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1ed609a9-71ea-4425-90f8-b18d80a88ffc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:36.305554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1ed609a9-71ea-4425-90f8-b18d80a88ffc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:36.306006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1ed609a9-71ea-4425-90f8-b18d80a88ffc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:36.306458 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1ed609a9-71ea-4425-90f8-b18d80a88ffc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:36.382821 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f24a7e66-2b4b-4082-949d-fafc5c655821 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:36.390229 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f24a7e66-2b4b-4082-949d-fafc5c655821 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.150379 Aug 08 02:26:36.390828 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 101/208] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:36 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:36.440661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1ed609a9-71ea-4425-90f8-b18d80a88ffc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:36.448253 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1ed609a9-71ea-4425-90f8-b18d80a88ffc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.159185 Aug 08 02:26:36.448788 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 108/209] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:36 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:36.751384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0e12a0ca-9992-4cc4-92fd-f84e12cfc6ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:36.751990 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0e12a0ca-9992-4cc4-92fd-f84e12cfc6ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:36.757884 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e12a0ca-9992-4cc4-92fd-f84e12cfc6ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:36.758393 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e12a0ca-9992-4cc4-92fd-f84e12cfc6ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:36.758821 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e12a0ca-9992-4cc4-92fd-f84e12cfc6ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:36.759494 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e12a0ca-9992-4cc4-92fd-f84e12cfc6ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:36.759938 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e12a0ca-9992-4cc4-92fd-f84e12cfc6ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:36.760349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e12a0ca-9992-4cc4-92fd-f84e12cfc6ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:36.823057 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0e12a0ca-9992-4cc4-92fd-f84e12cfc6ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:36.831402 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0e12a0ca-9992-4cc4-92fd-f84e12cfc6ac tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1273 microversion: 2.1 time: 0.083782 Aug 08 02:26:36.832058 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 102/210] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:36 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:37.242891 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-87ae645f-5a4b-4ddd-967d-944a9ad66492 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:37.243836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-87ae645f-5a4b-4ddd-967d-944a9ad66492 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:37.249841 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-87ae645f-5a4b-4ddd-967d-944a9ad66492 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:37.250353 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-87ae645f-5a4b-4ddd-967d-944a9ad66492 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:37.251458 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-87ae645f-5a4b-4ddd-967d-944a9ad66492 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:37.252156 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-87ae645f-5a4b-4ddd-967d-944a9ad66492 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:37.252613 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-87ae645f-5a4b-4ddd-967d-944a9ad66492 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:37.253041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-87ae645f-5a4b-4ddd-967d-944a9ad66492 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:37.267718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fcc66399-4e24-42c7-922c-885ed0309cdc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:37.268323 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fcc66399-4e24-42c7-922c-885ed0309cdc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:37.274362 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcc66399-4e24-42c7-922c-885ed0309cdc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:37.274839 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcc66399-4e24-42c7-922c-885ed0309cdc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:37.275270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcc66399-4e24-42c7-922c-885ed0309cdc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:37.275945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcc66399-4e24-42c7-922c-885ed0309cdc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:37.276871 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcc66399-4e24-42c7-922c-885ed0309cdc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:37.277287 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcc66399-4e24-42c7-922c-885ed0309cdc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:37.399347 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-87ae645f-5a4b-4ddd-967d-944a9ad66492 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:37.410272 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-87ae645f-5a4b-4ddd-967d-944a9ad66492 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.171060 Aug 08 02:26:37.410871 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 109/211] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:37 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:37.415380 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8259c91a-dd89-48e6-be3b-65a68f4e5ab3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:37.417683 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8259c91a-dd89-48e6-be3b-65a68f4e5ab3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:37.420505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fcc66399-4e24-42c7-922c-885ed0309cdc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:37.423992 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8259c91a-dd89-48e6-be3b-65a68f4e5ab3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:37.424480 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8259c91a-dd89-48e6-be3b-65a68f4e5ab3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:37.424916 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8259c91a-dd89-48e6-be3b-65a68f4e5ab3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:37.425611 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8259c91a-dd89-48e6-be3b-65a68f4e5ab3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:37.426061 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8259c91a-dd89-48e6-be3b-65a68f4e5ab3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:37.426505 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8259c91a-dd89-48e6-be3b-65a68f4e5ab3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:37.434440 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fcc66399-4e24-42c7-922c-885ed0309cdc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.170330 Aug 08 02:26:37.435215 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 103/212] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:37 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:37.468575 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-88dae002-782d-4176-bc7f-d931e1c29252 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:37.469180 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-88dae002-782d-4176-bc7f-d931e1c29252 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:37.475386 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88dae002-782d-4176-bc7f-d931e1c29252 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:37.475865 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88dae002-782d-4176-bc7f-d931e1c29252 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:37.476290 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88dae002-782d-4176-bc7f-d931e1c29252 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:37.476974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88dae002-782d-4176-bc7f-d931e1c29252 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:37.477464 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88dae002-782d-4176-bc7f-d931e1c29252 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:37.477883 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88dae002-782d-4176-bc7f-d931e1c29252 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:37.564582 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8259c91a-dd89-48e6-be3b-65a68f4e5ab3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:37.572625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8259c91a-dd89-48e6-be3b-65a68f4e5ab3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.160778 Aug 08 02:26:37.573193 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 110/213] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:37 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:37.612927 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-88dae002-782d-4176-bc7f-d931e1c29252 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:37.620904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-88dae002-782d-4176-bc7f-d931e1c29252 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.155589 Aug 08 02:26:37.621528 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 104/214] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:37 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:37.852852 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-32796489-366a-4489-a194-97a4fd34ede8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:37.853592 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-32796489-366a-4489-a194-97a4fd34ede8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:37.860079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-32796489-366a-4489-a194-97a4fd34ede8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:37.860671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-32796489-366a-4489-a194-97a4fd34ede8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:37.860962 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-32796489-366a-4489-a194-97a4fd34ede8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:37.861639 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-32796489-366a-4489-a194-97a4fd34ede8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:37.862078 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-32796489-366a-4489-a194-97a4fd34ede8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:37.862519 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-32796489-366a-4489-a194-97a4fd34ede8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:37.928406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-32796489-366a-4489-a194-97a4fd34ede8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:37.936285 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-32796489-366a-4489-a194-97a4fd34ede8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1273 microversion: 2.1 time: 0.087470 Aug 08 02:26:37.936838 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 111/215] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:37 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:38.435334 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0c2e3169-ab90-4914-997c-4376e0269081 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:38.435927 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0c2e3169-ab90-4914-997c-4376e0269081 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:38.442054 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c2e3169-ab90-4914-997c-4376e0269081 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:38.442572 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c2e3169-ab90-4914-997c-4376e0269081 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:38.443003 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c2e3169-ab90-4914-997c-4376e0269081 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:38.443682 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c2e3169-ab90-4914-997c-4376e0269081 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:38.444130 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c2e3169-ab90-4914-997c-4376e0269081 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:38.444548 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c2e3169-ab90-4914-997c-4376e0269081 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:38.455739 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-668bc19e-5230-4950-ad79-417104996bc5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:38.456348 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-668bc19e-5230-4950-ad79-417104996bc5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:38.462188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-668bc19e-5230-4950-ad79-417104996bc5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:38.462701 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-668bc19e-5230-4950-ad79-417104996bc5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:38.463133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-668bc19e-5230-4950-ad79-417104996bc5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:38.463844 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-668bc19e-5230-4950-ad79-417104996bc5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:38.464872 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-668bc19e-5230-4950-ad79-417104996bc5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:38.465294 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-668bc19e-5230-4950-ad79-417104996bc5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:38.583108 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0c2e3169-ab90-4914-997c-4376e0269081 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:38.591716 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0c2e3169-ab90-4914-997c-4376e0269081 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.160281 Aug 08 02:26:38.592327 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 105/216] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:38 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:38.596355 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-668bc19e-5230-4950-ad79-417104996bc5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:38.597155 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2a51c706-7985-4c00-b660-d10aa38ba0fc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:38.597754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2a51c706-7985-4c00-b660-d10aa38ba0fc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:38.603681 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a51c706-7985-4c00-b660-d10aa38ba0fc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:38.604155 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a51c706-7985-4c00-b660-d10aa38ba0fc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:38.605199 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a51c706-7985-4c00-b660-d10aa38ba0fc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:38.605912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-668bc19e-5230-4950-ad79-417104996bc5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.152606 Aug 08 02:26:38.606043 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a51c706-7985-4c00-b660-d10aa38ba0fc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:38.606239 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 112/217] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:38 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:38.606553 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a51c706-7985-4c00-b660-d10aa38ba0fc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:38.606941 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a51c706-7985-4c00-b660-d10aa38ba0fc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:38.640693 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-56fefbb1-f6b2-4079-9704-93a365bea43d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:38.641296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-56fefbb1-f6b2-4079-9704-93a365bea43d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:38.647404 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56fefbb1-f6b2-4079-9704-93a365bea43d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:38.647888 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56fefbb1-f6b2-4079-9704-93a365bea43d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:38.648317 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56fefbb1-f6b2-4079-9704-93a365bea43d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:38.649007 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56fefbb1-f6b2-4079-9704-93a365bea43d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:38.649455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56fefbb1-f6b2-4079-9704-93a365bea43d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:38.649928 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56fefbb1-f6b2-4079-9704-93a365bea43d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:38.746365 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2a51c706-7985-4c00-b660-d10aa38ba0fc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:38.749826 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:38.754581 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2a51c706-7985-4c00-b660-d10aa38ba0fc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.161015 Aug 08 02:26:38.755163 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 106/218] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:38 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:38.784463 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-56fefbb1-f6b2-4079-9704-93a365bea43d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:38.791789 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-56fefbb1-f6b2-4079-9704-93a365bea43d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.154872 Aug 08 02:26:38.792975 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 113/219] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:38 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:38.956769 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-168b1748-76dc-43f2-a5b7-0352bfef5ad9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:38.957385 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-168b1748-76dc-43f2-a5b7-0352bfef5ad9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:38.967344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-168b1748-76dc-43f2-a5b7-0352bfef5ad9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:38.968174 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-168b1748-76dc-43f2-a5b7-0352bfef5ad9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:38.968593 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-168b1748-76dc-43f2-a5b7-0352bfef5ad9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:38.970053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-168b1748-76dc-43f2-a5b7-0352bfef5ad9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:38.970557 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-168b1748-76dc-43f2-a5b7-0352bfef5ad9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:38.970993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-168b1748-76dc-43f2-a5b7-0352bfef5ad9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:39.058928 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-168b1748-76dc-43f2-a5b7-0352bfef5ad9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:39.069152 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-168b1748-76dc-43f2-a5b7-0352bfef5ad9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1283 microversion: 2.1 time: 0.116178 Aug 08 02:26:39.071510 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 107/220] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:38 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1283 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:39.257698 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-627260205", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:39.316642 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.network.neutron [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] validate_networks() for None {{(pid=117640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:26:39.612285 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-67160e49-e005-4117-8194-15fda7a18504 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:39.612902 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-67160e49-e005-4117-8194-15fda7a18504 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:39.618894 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67160e49-e005-4117-8194-15fda7a18504 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:39.619374 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67160e49-e005-4117-8194-15fda7a18504 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:39.619550 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Flavor limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:26:39.619946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67160e49-e005-4117-8194-15fda7a18504 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:39.620068 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Image limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:26:39.620513 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67160e49-e005-4117-8194-15fda7a18504 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:39.620618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Flavor pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:26:39.620917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Image pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:26:39.621019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67160e49-e005-4117-8194-15fda7a18504 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:39.621362 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67160e49-e005-4117-8194-15fda7a18504 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:39.621453 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:26:39.630600 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:39.631079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:39.631535 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:39.632373 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:39.633056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:39.633482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:39.650328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Getting quotas for project c4a56db115f64261ae4b472567a2265e. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:26:39.655144 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Getting quotas for user 2b69dd6e1f7c4d93af3a27f310a7704c and project c4a56db115f64261ae4b472567a2265e. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:26:39.667978 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Going to run 1 instances... {{(pid=117640) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:26:39.670268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:26:39.719900 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5a7c7edb-68ac-48f7-ac5b-5c50c229cd9c tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.465957 Aug 08 02:26:39.724779 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 114/221] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:26:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:26:39.729473 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a86a2e66-15e9-4e6d-b9b3-8f04d2e4f0c2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:39.730290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a86a2e66-15e9-4e6d-b9b3-8f04d2e4f0c2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:39.741932 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a86a2e66-15e9-4e6d-b9b3-8f04d2e4f0c2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:39.742699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a86a2e66-15e9-4e6d-b9b3-8f04d2e4f0c2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:39.743333 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a86a2e66-15e9-4e6d-b9b3-8f04d2e4f0c2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:39.744259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a86a2e66-15e9-4e6d-b9b3-8f04d2e4f0c2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:39.744882 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a86a2e66-15e9-4e6d-b9b3-8f04d2e4f0c2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:39.745566 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a86a2e66-15e9-4e6d-b9b3-8f04d2e4f0c2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:39.893197 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-67160e49-e005-4117-8194-15fda7a18504 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:39.903498 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-67160e49-e005-4117-8194-15fda7a18504 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1314 microversion: 2.1 time: 0.295099 Aug 08 02:26:39.904364 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 108/222] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:39 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:39.909603 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6fd47986-a32e-42f7-8928-1d100dbce31b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:39.910542 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6fd47986-a32e-42f7-8928-1d100dbce31b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:40.000047 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6fd47986-a32e-42f7-8928-1d100dbce31b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:40.013897 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6fd47986-a32e-42f7-8928-1d100dbce31b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1214 microversion: 2.1 time: 0.107781 Aug 08 02:26:40.017031 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 109/223] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:39 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:40.022813 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0bd6e415-ee90-49fc-94f3-867fd72f60e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:40.038192 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0bd6e415-ee90-49fc-94f3-867fd72f60e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:40.053862 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bd6e415-ee90-49fc-94f3-867fd72f60e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:40.054519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bd6e415-ee90-49fc-94f3-867fd72f60e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:40.055029 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bd6e415-ee90-49fc-94f3-867fd72f60e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:40.055812 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bd6e415-ee90-49fc-94f3-867fd72f60e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:40.056335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bd6e415-ee90-49fc-94f3-867fd72f60e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:40.058489 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bd6e415-ee90-49fc-94f3-867fd72f60e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:40.169231 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a86a2e66-15e9-4e6d-b9b3-8f04d2e4f0c2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:40.177918 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a86a2e66-15e9-4e6d-b9b3-8f04d2e4f0c2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.455943 Aug 08 02:26:40.178854 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 115/224] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:39 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:40.184812 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-cc1ca749-a967-4a16-a880-67db66208c4c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:40.185689 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-cc1ca749-a967-4a16-a880-67db66208c4c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:40.192527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cc1ca749-a967-4a16-a880-67db66208c4c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:40.193095 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cc1ca749-a967-4a16-a880-67db66208c4c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:40.193608 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cc1ca749-a967-4a16-a880-67db66208c4c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:40.194754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cc1ca749-a967-4a16-a880-67db66208c4c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:40.195320 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cc1ca749-a967-4a16-a880-67db66208c4c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:40.195773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cc1ca749-a967-4a16-a880-67db66208c4c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:40.269825 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0bd6e415-ee90-49fc-94f3-867fd72f60e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:40.284658 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0bd6e415-ee90-49fc-94f3-867fd72f60e3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.266322 Aug 08 02:26:40.285407 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 110/225] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:40 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:40.300978 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-14175e48-e3ed-4119-a364-35e8f710711e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:40.301975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-14175e48-e3ed-4119-a364-35e8f710711e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:40.313108 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14175e48-e3ed-4119-a364-35e8f710711e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:40.313602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14175e48-e3ed-4119-a364-35e8f710711e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:40.314035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14175e48-e3ed-4119-a364-35e8f710711e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:40.315988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14175e48-e3ed-4119-a364-35e8f710711e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:40.316417 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14175e48-e3ed-4119-a364-35e8f710711e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:40.316933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14175e48-e3ed-4119-a364-35e8f710711e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:40.398447 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-14175e48-e3ed-4119-a364-35e8f710711e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:40.407566 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-14175e48-e3ed-4119-a364-35e8f710711e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1271 microversion: 2.1 time: 0.120986 Aug 08 02:26:40.409274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 111/226] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:40 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:40.427571 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-cc1ca749-a967-4a16-a880-67db66208c4c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:40.437290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-cc1ca749-a967-4a16-a880-67db66208c4c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.257023 Aug 08 02:26:40.437867 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 116/227] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:40 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:40.924770 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d8f2d83b-3593-49cd-be02-fdd76910e38c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:40.925474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d8f2d83b-3593-49cd-be02-fdd76910e38c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:40.932110 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d8f2d83b-3593-49cd-be02-fdd76910e38c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:40.932332 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d8f2d83b-3593-49cd-be02-fdd76910e38c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:40.932928 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d8f2d83b-3593-49cd-be02-fdd76910e38c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:40.933498 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d8f2d83b-3593-49cd-be02-fdd76910e38c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:40.933908 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d8f2d83b-3593-49cd-be02-fdd76910e38c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:40.934362 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d8f2d83b-3593-49cd-be02-fdd76910e38c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:41.036913 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8b4833cd-13bf-4221-aa33-18229e9ad4f4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:41.037620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8b4833cd-13bf-4221-aa33-18229e9ad4f4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:41.045998 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8b4833cd-13bf-4221-aa33-18229e9ad4f4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:41.048268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8b4833cd-13bf-4221-aa33-18229e9ad4f4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:41.048792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8b4833cd-13bf-4221-aa33-18229e9ad4f4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:41.050749 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8b4833cd-13bf-4221-aa33-18229e9ad4f4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:41.055192 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8b4833cd-13bf-4221-aa33-18229e9ad4f4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:41.055741 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8b4833cd-13bf-4221-aa33-18229e9ad4f4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:41.060473 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:41.077116 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d8f2d83b-3593-49cd-be02-fdd76910e38c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:41.084754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d8f2d83b-3593-49cd-be02-fdd76910e38c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1502 microversion: 2.1 time: 0.163938 Aug 08 02:26:41.085512 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 112/228] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:40 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:41.164054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8b4833cd-13bf-4221-aa33-18229e9ad4f4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:41.175758 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8b4833cd-13bf-4221-aa33-18229e9ad4f4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1218 microversion: 2.1 time: 0.142598 Aug 08 02:26:41.176336 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 117/229] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:41 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:41.201025 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e96f1c8d-c673-46f1-bc63-9afd45c119d1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:41.201638 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e96f1c8d-c673-46f1-bc63-9afd45c119d1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:41.207887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e96f1c8d-c673-46f1-bc63-9afd45c119d1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:41.208375 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e96f1c8d-c673-46f1-bc63-9afd45c119d1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:41.208807 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e96f1c8d-c673-46f1-bc63-9afd45c119d1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:41.209534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e96f1c8d-c673-46f1-bc63-9afd45c119d1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:41.209984 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e96f1c8d-c673-46f1-bc63-9afd45c119d1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:41.210496 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e96f1c8d-c673-46f1-bc63-9afd45c119d1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:41.306525 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ac916750-37c0-4725-b3e9-7dbb5d0c83e6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:41.307710 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ac916750-37c0-4725-b3e9-7dbb5d0c83e6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:41.315392 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ac916750-37c0-4725-b3e9-7dbb5d0c83e6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:41.316286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ac916750-37c0-4725-b3e9-7dbb5d0c83e6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:41.317206 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ac916750-37c0-4725-b3e9-7dbb5d0c83e6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:41.319178 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ac916750-37c0-4725-b3e9-7dbb5d0c83e6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:41.319604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ac916750-37c0-4725-b3e9-7dbb5d0c83e6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:41.320484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ac916750-37c0-4725-b3e9-7dbb5d0c83e6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:41.351560 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e96f1c8d-c673-46f1-bc63-9afd45c119d1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:41.376873 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e96f1c8d-c673-46f1-bc63-9afd45c119d1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.179394 Aug 08 02:26:41.391175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 113/230] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:41 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:41.437394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2e19c5e3-052c-4e29-9982-65717efd59ae tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:41.438241 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2e19c5e3-052c-4e29-9982-65717efd59ae tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:41.448784 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e19c5e3-052c-4e29-9982-65717efd59ae tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:41.449508 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e19c5e3-052c-4e29-9982-65717efd59ae tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:41.450191 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e19c5e3-052c-4e29-9982-65717efd59ae tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:41.451276 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e19c5e3-052c-4e29-9982-65717efd59ae tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:41.451966 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e19c5e3-052c-4e29-9982-65717efd59ae tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:41.452770 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e19c5e3-052c-4e29-9982-65717efd59ae tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:41.487569 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ac916750-37c0-4725-b3e9-7dbb5d0c83e6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:41.496343 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ac916750-37c0-4725-b3e9-7dbb5d0c83e6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.195003 Aug 08 02:26:41.496919 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 118/231] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:41 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:41.501484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7d5419e9-54b3-46ab-b390-e4ae272b01e8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:41.502303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7d5419e9-54b3-46ab-b390-e4ae272b01e8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:41.508403 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7d5419e9-54b3-46ab-b390-e4ae272b01e8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:41.509042 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7d5419e9-54b3-46ab-b390-e4ae272b01e8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:41.509625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7d5419e9-54b3-46ab-b390-e4ae272b01e8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:41.510367 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7d5419e9-54b3-46ab-b390-e4ae272b01e8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:41.511342 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7d5419e9-54b3-46ab-b390-e4ae272b01e8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:41.511758 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7d5419e9-54b3-46ab-b390-e4ae272b01e8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:41.590631 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2e19c5e3-052c-4e29-9982-65717efd59ae tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:41.599578 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2e19c5e3-052c-4e29-9982-65717efd59ae tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.166103 Aug 08 02:26:41.600168 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 114/232] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:41 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:41.737143 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7d5419e9-54b3-46ab-b390-e4ae272b01e8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:41.746113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7d5419e9-54b3-46ab-b390-e4ae272b01e8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1366 microversion: 2.1 time: 0.248205 Aug 08 02:26:41.754491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 119/233] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:41 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:42.195645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-19c841b5-3597-4370-82f0-42a3c3f32c31 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:42.196968 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-19c841b5-3597-4370-82f0-42a3c3f32c31 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:42.203164 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19c841b5-3597-4370-82f0-42a3c3f32c31 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:42.203823 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19c841b5-3597-4370-82f0-42a3c3f32c31 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:42.204254 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19c841b5-3597-4370-82f0-42a3c3f32c31 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:42.205017 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19c841b5-3597-4370-82f0-42a3c3f32c31 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:42.205473 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19c841b5-3597-4370-82f0-42a3c3f32c31 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:42.206058 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19c841b5-3597-4370-82f0-42a3c3f32c31 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:42.295930 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-19c841b5-3597-4370-82f0-42a3c3f32c31 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:42.303611 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-19c841b5-3597-4370-82f0-42a3c3f32c31 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1210 microversion: 2.1 time: 0.111686 Aug 08 02:26:42.304188 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 115/234] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:42 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:42.399866 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a3929893-9ec1-4eb4-87f7-d02fa665e4f6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:42.400567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a3929893-9ec1-4eb4-87f7-d02fa665e4f6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:42.407244 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a3929893-9ec1-4eb4-87f7-d02fa665e4f6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:42.407724 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a3929893-9ec1-4eb4-87f7-d02fa665e4f6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:42.408153 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a3929893-9ec1-4eb4-87f7-d02fa665e4f6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:42.408897 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a3929893-9ec1-4eb4-87f7-d02fa665e4f6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:42.409356 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a3929893-9ec1-4eb4-87f7-d02fa665e4f6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:42.409776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a3929893-9ec1-4eb4-87f7-d02fa665e4f6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:42.492924 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-476c9032-8bcd-4614-8267-8139fd8b52a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1570979-6428-4402-b5f2-8edab9abe360"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:42.496264 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-476c9032-8bcd-4614-8267-8139fd8b52a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:42.503254 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-476c9032-8bcd-4614-8267-8139fd8b52a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:42.504541 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-476c9032-8bcd-4614-8267-8139fd8b52a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:42.505215 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-476c9032-8bcd-4614-8267-8139fd8b52a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:42.506368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-476c9032-8bcd-4614-8267-8139fd8b52a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:42.508623 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-476c9032-8bcd-4614-8267-8139fd8b52a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:42.509359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-476c9032-8bcd-4614-8267-8139fd8b52a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:42.665309 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a3929893-9ec1-4eb4-87f7-d02fa665e4f6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:42.673868 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a3929893-9ec1-4eb4-87f7-d02fa665e4f6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.277869 Aug 08 02:26:42.674480 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 120/235] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:42 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:42.679149 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-22477bef-60ec-45ef-ac50-c0c1386547ba tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:42.679751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-22477bef-60ec-45ef-ac50-c0c1386547ba tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:42.687078 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22477bef-60ec-45ef-ac50-c0c1386547ba tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:42.687542 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22477bef-60ec-45ef-ac50-c0c1386547ba tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:42.688000 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22477bef-60ec-45ef-ac50-c0c1386547ba tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:42.688691 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22477bef-60ec-45ef-ac50-c0c1386547ba tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:42.689393 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22477bef-60ec-45ef-ac50-c0c1386547ba tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:42.689891 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22477bef-60ec-45ef-ac50-c0c1386547ba tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:42.864874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-22477bef-60ec-45ef-ac50-c0c1386547ba tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:42.875023 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-22477bef-60ec-45ef-ac50-c0c1386547ba tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1362 microversion: 2.1 time: 0.199213 Aug 08 02:26:42.875841 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 121/236] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:42 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:42.882255 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-2436017d-7728-42ad-a925-6bdca7e2d156 req-9e527d75-8f54-4aab-a3f7-fbf0526f41d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f526af59-111b-48d0-a2aa-b861530026b9", "tag": "da5825a9-2610-47e2-97f4-499c5f751915"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:42.893864 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-2436017d-7728-42ad-a925-6bdca7e2d156 req-9e527d75-8f54-4aab-a3f7-fbf0526f41d5 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:42.894567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-2436017d-7728-42ad-a925-6bdca7e2d156 req-9e527d75-8f54-4aab-a3f7-fbf0526f41d5 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:42.895161 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-2436017d-7728-42ad-a925-6bdca7e2d156 req-9e527d75-8f54-4aab-a3f7-fbf0526f41d5 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:42.907732 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-2436017d-7728-42ad-a925-6bdca7e2d156 req-9e527d75-8f54-4aab-a3f7-fbf0526f41d5 service nova] Creating event network-changed:da5825a9-2610-47e2-97f4-499c5f751915 for instance f526af59-111b-48d0-a2aa-b861530026b9 on hv-cinder-73306 Aug 08 02:26:42.912773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-2436017d-7728-42ad-a925-6bdca7e2d156 req-9e527d75-8f54-4aab-a3f7-fbf0526f41d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035350 Aug 08 02:26:42.913360 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 122/237] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:42.919187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8ff6d756-f1da-4550-a1af-065665fc3da8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:42.920157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8ff6d756-f1da-4550-a1af-065665fc3da8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:42.926837 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8ff6d756-f1da-4550-a1af-065665fc3da8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:42.927323 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8ff6d756-f1da-4550-a1af-065665fc3da8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:42.927752 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8ff6d756-f1da-4550-a1af-065665fc3da8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:42.928439 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8ff6d756-f1da-4550-a1af-065665fc3da8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:42.929225 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8ff6d756-f1da-4550-a1af-065665fc3da8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:42.929813 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8ff6d756-f1da-4550-a1af-065665fc3da8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:43.102694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8ff6d756-f1da-4550-a1af-065665fc3da8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:43.114849 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8ff6d756-f1da-4550-a1af-065665fc3da8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.199931 Aug 08 02:26:43.115619 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 123/238] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:42 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:43.134271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5d8abab9-a123-4ebf-84ba-363e45846736 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:43.135105 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5d8abab9-a123-4ebf-84ba-363e45846736 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:43.142099 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5d8abab9-a123-4ebf-84ba-363e45846736 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:43.142647 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5d8abab9-a123-4ebf-84ba-363e45846736 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:43.143104 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5d8abab9-a123-4ebf-84ba-363e45846736 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:43.143846 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5d8abab9-a123-4ebf-84ba-363e45846736 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:43.144333 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5d8abab9-a123-4ebf-84ba-363e45846736 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:43.144950 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5d8abab9-a123-4ebf-84ba-363e45846736 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:43.281560 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5d8abab9-a123-4ebf-84ba-363e45846736 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:43.289753 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5d8abab9-a123-4ebf-84ba-363e45846736 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1556 microversion: 2.1 time: 0.169992 Aug 08 02:26:43.290338 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 124/239] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:43 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:43.310716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7df56ca1-0665-4581-9cc7-05e38418dc23 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:43.311326 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7df56ca1-0665-4581-9cc7-05e38418dc23 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:43.318163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7df56ca1-0665-4581-9cc7-05e38418dc23 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:43.320280 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7df56ca1-0665-4581-9cc7-05e38418dc23 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:43.320719 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7df56ca1-0665-4581-9cc7-05e38418dc23 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:43.321447 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7df56ca1-0665-4581-9cc7-05e38418dc23 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:43.321939 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7df56ca1-0665-4581-9cc7-05e38418dc23 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:43.322665 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7df56ca1-0665-4581-9cc7-05e38418dc23 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:43.454783 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7df56ca1-0665-4581-9cc7-05e38418dc23 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148071 Aug 08 02:26:43.455379 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 125/240] 10.222.0.39 () {58 vars in 1275 bytes} [Mon Aug 8 02:26:43 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:26:43.460164 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e2f8731f-06a5-47eb-ab73-1309def228ca tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:43.461034 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e2f8731f-06a5-47eb-ab73-1309def228ca tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:43.468754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e2f8731f-06a5-47eb-ab73-1309def228ca tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:43.469218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e2f8731f-06a5-47eb-ab73-1309def228ca tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:43.469648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e2f8731f-06a5-47eb-ab73-1309def228ca tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:43.470359 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e2f8731f-06a5-47eb-ab73-1309def228ca tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:43.470808 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e2f8731f-06a5-47eb-ab73-1309def228ca tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:43.471226 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e2f8731f-06a5-47eb-ab73-1309def228ca tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:43.572347 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e2f8731f-06a5-47eb-ab73-1309def228ca tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:43.580286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e2f8731f-06a5-47eb-ab73-1309def228ca tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1266 microversion: 2.1 time: 0.123933 Aug 08 02:26:43.580861 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 126/241] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:43 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:43.696328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-90c21968-8117-4482-adea-6496bf85a5eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:43.696648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-90c21968-8117-4482-adea-6496bf85a5eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:43.703706 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-90c21968-8117-4482-adea-6496bf85a5eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:43.704195 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-90c21968-8117-4482-adea-6496bf85a5eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:43.704809 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-90c21968-8117-4482-adea-6496bf85a5eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:43.705498 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-90c21968-8117-4482-adea-6496bf85a5eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:43.705971 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-90c21968-8117-4482-adea-6496bf85a5eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:43.706386 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-90c21968-8117-4482-adea-6496bf85a5eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:43.945335 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-90c21968-8117-4482-adea-6496bf85a5eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:43.954822 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-90c21968-8117-4482-adea-6496bf85a5eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.262589 Aug 08 02:26:43.955363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 127/242] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:43 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:43.976551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ee104d8c-9c8f-4a7e-99b7-dc7727305e40 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:43.977159 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ee104d8c-9c8f-4a7e-99b7-dc7727305e40 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:43.985336 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ee104d8c-9c8f-4a7e-99b7-dc7727305e40 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:43.985808 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ee104d8c-9c8f-4a7e-99b7-dc7727305e40 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:43.986234 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ee104d8c-9c8f-4a7e-99b7-dc7727305e40 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:43.986939 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ee104d8c-9c8f-4a7e-99b7-dc7727305e40 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:43.987384 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ee104d8c-9c8f-4a7e-99b7-dc7727305e40 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:43.987800 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ee104d8c-9c8f-4a7e-99b7-dc7727305e40 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:44.406269 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ee104d8c-9c8f-4a7e-99b7-dc7727305e40 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:44.421592 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ee104d8c-9c8f-4a7e-99b7-dc7727305e40 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1547 microversion: 2.1 time: 0.448726 Aug 08 02:26:44.422659 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 128/243] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:43 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1547 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:44.454388 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2815a354-4bd1-4276-91a0-70b09146e719 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:44.458210 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2815a354-4bd1-4276-91a0-70b09146e719 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:44.470934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2815a354-4bd1-4276-91a0-70b09146e719 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:44.471723 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2815a354-4bd1-4276-91a0-70b09146e719 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:44.472372 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2815a354-4bd1-4276-91a0-70b09146e719 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:44.473197 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2815a354-4bd1-4276-91a0-70b09146e719 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:44.473797 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2815a354-4bd1-4276-91a0-70b09146e719 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:44.474555 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2815a354-4bd1-4276-91a0-70b09146e719 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:44.989204 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2815a354-4bd1-4276-91a0-70b09146e719 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:44.997557 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2815a354-4bd1-4276-91a0-70b09146e719 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.573658 Aug 08 02:26:44.998146 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 129/244] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:44 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:45.002838 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c121ec51-2ff4-4ca1-ad80-494a4ff48b3a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:45.003320 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c121ec51-2ff4-4ca1-ad80-494a4ff48b3a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:45.008905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c121ec51-2ff4-4ca1-ad80-494a4ff48b3a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:45.009400 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c121ec51-2ff4-4ca1-ad80-494a4ff48b3a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:45.009827 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c121ec51-2ff4-4ca1-ad80-494a4ff48b3a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:45.011059 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c121ec51-2ff4-4ca1-ad80-494a4ff48b3a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:45.011542 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c121ec51-2ff4-4ca1-ad80-494a4ff48b3a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:45.011959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c121ec51-2ff4-4ca1-ad80-494a4ff48b3a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:45.274981 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c121ec51-2ff4-4ca1-ad80-494a4ff48b3a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.275509 Aug 08 02:26:45.282799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 130/245] 10.222.0.39 () {58 vars in 1275 bytes} [Mon Aug 8 02:26:44 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/os-interface => generated 284 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:45.282977 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-476c9032-8bcd-4614-8267-8139fd8b52a5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "POST /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.792768 Aug 08 02:26:45.282977 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 116/246] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:26:42 2022] POST /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458/os-volume_attachments => generated 194 bytes in 2794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:26:45.289689 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c3830a50-b706-494b-956e-5c0d43662c00 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:45.290536 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c3830a50-b706-494b-956e-5c0d43662c00 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:45.290764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a18109ca-361e-4951-ae17-466025d270c9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:45.291589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a18109ca-361e-4951-ae17-466025d270c9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:45.298327 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a18109ca-361e-4951-ae17-466025d270c9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:45.299012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a18109ca-361e-4951-ae17-466025d270c9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:45.299780 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a18109ca-361e-4951-ae17-466025d270c9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:45.301671 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a18109ca-361e-4951-ae17-466025d270c9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:45.302368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a18109ca-361e-4951-ae17-466025d270c9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:45.303033 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a18109ca-361e-4951-ae17-466025d270c9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:45.320810 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c3830a50-b706-494b-956e-5c0d43662c00 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:45.321669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c3830a50-b706-494b-956e-5c0d43662c00 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:45.322104 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c3830a50-b706-494b-956e-5c0d43662c00 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:45.327826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c3830a50-b706-494b-956e-5c0d43662c00 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:45.329775 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c3830a50-b706-494b-956e-5c0d43662c00 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:45.332006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c3830a50-b706-494b-956e-5c0d43662c00 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:45.493066 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c3830a50-b706-494b-956e-5c0d43662c00 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:45.502536 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c3830a50-b706-494b-956e-5c0d43662c00 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1284 microversion: 2.1 time: 0.225962 Aug 08 02:26:45.503115 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 131/247] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:45 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:45.758214 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-bdad96d9-89ff-4e76-b1c4-0a1e6a457457 req-ad1300ad-1338-4e61-9f1e-81223de9a3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4568714-ae5a-47eb-9140-be5702dd288e", "tag": "64cd5cbd-515d-4839-a3a7-ee52df20970a"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:45.768055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-bdad96d9-89ff-4e76-b1c4-0a1e6a457457 req-ad1300ad-1338-4e61-9f1e-81223de9a3a6 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:45.768749 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-bdad96d9-89ff-4e76-b1c4-0a1e6a457457 req-ad1300ad-1338-4e61-9f1e-81223de9a3a6 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:45.769358 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-bdad96d9-89ff-4e76-b1c4-0a1e6a457457 req-ad1300ad-1338-4e61-9f1e-81223de9a3a6 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:45.781188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-bdad96d9-89ff-4e76-b1c4-0a1e6a457457 req-ad1300ad-1338-4e61-9f1e-81223de9a3a6 service nova] Creating event network-changed:64cd5cbd-515d-4839-a3a7-ee52df20970a for instance b4568714-ae5a-47eb-9140-be5702dd288e on hv-cinder-73306 Aug 08 02:26:45.786646 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-bdad96d9-89ff-4e76-b1c4-0a1e6a457457 req-ad1300ad-1338-4e61-9f1e-81223de9a3a6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031924 Aug 08 02:26:45.791136 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 132/248] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:26:46.020283 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8fc2b8cb-214f-41b8-9038-ce59293e40eb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:46.021052 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8fc2b8cb-214f-41b8-9038-ce59293e40eb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:46.043993 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8fc2b8cb-214f-41b8-9038-ce59293e40eb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:46.044486 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8fc2b8cb-214f-41b8-9038-ce59293e40eb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:46.044940 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8fc2b8cb-214f-41b8-9038-ce59293e40eb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:46.045658 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8fc2b8cb-214f-41b8-9038-ce59293e40eb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:46.046114 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8fc2b8cb-214f-41b8-9038-ce59293e40eb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:46.046568 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8fc2b8cb-214f-41b8-9038-ce59293e40eb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:46.257544 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a18109ca-361e-4951-ae17-466025d270c9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:46.269754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a18109ca-361e-4951-ae17-466025d270c9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.982399 Aug 08 02:26:46.273152 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 117/249] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:45 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:46.401278 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8fc2b8cb-214f-41b8-9038-ce59293e40eb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:46.409465 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8fc2b8cb-214f-41b8-9038-ce59293e40eb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.393544 Aug 08 02:26:46.422750 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 133/250] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:46 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:46.524969 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a9938fac-a770-4e8c-beef-3cede59df1c4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:46.525891 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a9938fac-a770-4e8c-beef-3cede59df1c4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:46.531930 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9938fac-a770-4e8c-beef-3cede59df1c4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:46.532434 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9938fac-a770-4e8c-beef-3cede59df1c4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:46.533036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9938fac-a770-4e8c-beef-3cede59df1c4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:46.533730 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9938fac-a770-4e8c-beef-3cede59df1c4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:46.534179 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9938fac-a770-4e8c-beef-3cede59df1c4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:46.534620 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9938fac-a770-4e8c-beef-3cede59df1c4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:46.664877 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a9938fac-a770-4e8c-beef-3cede59df1c4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:46.674089 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a9938fac-a770-4e8c-beef-3cede59df1c4 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1272 microversion: 2.1 time: 0.152951 Aug 08 02:26:46.684355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 118/251] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:46 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:47.297858 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-94e014de-5dbb-45be-9be6-b858903c519e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:47.298504 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-94e014de-5dbb-45be-9be6-b858903c519e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:47.304585 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-94e014de-5dbb-45be-9be6-b858903c519e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:47.305057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-94e014de-5dbb-45be-9be6-b858903c519e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:47.305483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-94e014de-5dbb-45be-9be6-b858903c519e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:47.306155 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-94e014de-5dbb-45be-9be6-b858903c519e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:47.306896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-94e014de-5dbb-45be-9be6-b858903c519e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:47.307032 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-94e014de-5dbb-45be-9be6-b858903c519e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:47.429232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9e0cb75e-6341-450a-b5fe-2db2511765d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:47.430026 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9e0cb75e-6341-450a-b5fe-2db2511765d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:47.436747 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e0cb75e-6341-450a-b5fe-2db2511765d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:47.437373 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e0cb75e-6341-450a-b5fe-2db2511765d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:47.438053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e0cb75e-6341-450a-b5fe-2db2511765d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:47.438987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e0cb75e-6341-450a-b5fe-2db2511765d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:47.439756 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e0cb75e-6341-450a-b5fe-2db2511765d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:47.440404 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e0cb75e-6341-450a-b5fe-2db2511765d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:47.456764 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-94e014de-5dbb-45be-9be6-b858903c519e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:47.469120 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-94e014de-5dbb-45be-9be6-b858903c519e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.175165 Aug 08 02:26:47.470463 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 134/252] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:47 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:47.671485 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9e0cb75e-6341-450a-b5fe-2db2511765d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:47.678976 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9e0cb75e-6341-450a-b5fe-2db2511765d5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.253718 Aug 08 02:26:47.680118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 119/253] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:47 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:47.696472 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e8db263d-4f37-4114-96c6-dcead10778a8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:47.697169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e8db263d-4f37-4114-96c6-dcead10778a8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:47.703712 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e8db263d-4f37-4114-96c6-dcead10778a8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:47.704271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e8db263d-4f37-4114-96c6-dcead10778a8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:47.704778 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e8db263d-4f37-4114-96c6-dcead10778a8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:47.705602 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e8db263d-4f37-4114-96c6-dcead10778a8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:47.706286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e8db263d-4f37-4114-96c6-dcead10778a8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:47.706921 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e8db263d-4f37-4114-96c6-dcead10778a8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:47.773317 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e8db263d-4f37-4114-96c6-dcead10778a8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:47.777312 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:47.791460 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e8db263d-4f37-4114-96c6-dcead10778a8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1272 microversion: 2.1 time: 0.098756 Aug 08 02:26:47.792337 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 135/254] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:47 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:47.818970 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-f510f286-97bc-48d3-9930-4e35fc33542f req-b163c966-6b6c-4d6f-9b9e-4c5662aebd0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a61fcac-cea3-4e95-a463-bb2f44b28e39", "tag": "f05f2dd7-1c3e-44dc-8f0b-bf42643bdea5"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:47.828586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-f510f286-97bc-48d3-9930-4e35fc33542f req-b163c966-6b6c-4d6f-9b9e-4c5662aebd0d service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:47.829059 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-f510f286-97bc-48d3-9930-4e35fc33542f req-b163c966-6b6c-4d6f-9b9e-4c5662aebd0d service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:47.829478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-f510f286-97bc-48d3-9930-4e35fc33542f req-b163c966-6b6c-4d6f-9b9e-4c5662aebd0d service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:47.845866 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-f510f286-97bc-48d3-9930-4e35fc33542f req-b163c966-6b6c-4d6f-9b9e-4c5662aebd0d service nova] Creating event network-changed:f05f2dd7-1c3e-44dc-8f0b-bf42643bdea5 for instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 on hv-cinder-73306 Aug 08 02:26:47.851136 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-f510f286-97bc-48d3-9930-4e35fc33542f req-b163c966-6b6c-4d6f-9b9e-4c5662aebd0d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035698 Aug 08 02:26:47.851918 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 120/255] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:48.489996 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-56372612-1939-444d-8210-feee59782684 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:48.491692 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-56372612-1939-444d-8210-feee59782684 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:48.499440 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56372612-1939-444d-8210-feee59782684 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:48.499930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56372612-1939-444d-8210-feee59782684 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:48.500353 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56372612-1939-444d-8210-feee59782684 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:48.501211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56372612-1939-444d-8210-feee59782684 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:48.501665 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56372612-1939-444d-8210-feee59782684 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:48.502119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56372612-1939-444d-8210-feee59782684 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:48.661172 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-56372612-1939-444d-8210-feee59782684 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:48.674409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-56372612-1939-444d-8210-feee59782684 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.188034 Aug 08 02:26:48.686803 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 136/256] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:48 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:48.701442 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8dc4280e-9484-452e-9112-1e7f76838a28 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:48.702226 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8dc4280e-9484-452e-9112-1e7f76838a28 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:48.712292 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dc4280e-9484-452e-9112-1e7f76838a28 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:48.712912 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dc4280e-9484-452e-9112-1e7f76838a28 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:48.713449 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dc4280e-9484-452e-9112-1e7f76838a28 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:48.714432 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dc4280e-9484-452e-9112-1e7f76838a28 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:48.715066 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dc4280e-9484-452e-9112-1e7f76838a28 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:48.715491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8dc4280e-9484-452e-9112-1e7f76838a28 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:48.812456 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-601184e0-98c5-4715-9c5d-26eaff3d2aa6 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:48.813256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-601184e0-98c5-4715-9c5d-26eaff3d2aa6 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:48.825012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-601184e0-98c5-4715-9c5d-26eaff3d2aa6 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:48.827065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-601184e0-98c5-4715-9c5d-26eaff3d2aa6 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:48.827605 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-601184e0-98c5-4715-9c5d-26eaff3d2aa6 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:48.828391 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-601184e0-98c5-4715-9c5d-26eaff3d2aa6 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:48.831208 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-601184e0-98c5-4715-9c5d-26eaff3d2aa6 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:48.831737 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-601184e0-98c5-4715-9c5d-26eaff3d2aa6 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:48.864390 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8dc4280e-9484-452e-9112-1e7f76838a28 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:48.871870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8dc4280e-9484-452e-9112-1e7f76838a28 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.175582 Aug 08 02:26:48.872451 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 121/257] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:48 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:48.903602 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-601184e0-98c5-4715-9c5d-26eaff3d2aa6 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:48.917332 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-601184e0-98c5-4715-9c5d-26eaff3d2aa6 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1272 microversion: 2.1 time: 0.108593 Aug 08 02:26:48.917862 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 137/258] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:48 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:49.696912 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9cfd2963-dcfb-4b6a-b210-1a880f9d696e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:49.697089 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9cfd2963-dcfb-4b6a-b210-1a880f9d696e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:49.703573 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cfd2963-dcfb-4b6a-b210-1a880f9d696e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:49.704150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cfd2963-dcfb-4b6a-b210-1a880f9d696e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:49.704466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cfd2963-dcfb-4b6a-b210-1a880f9d696e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:49.705167 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cfd2963-dcfb-4b6a-b210-1a880f9d696e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:49.705594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cfd2963-dcfb-4b6a-b210-1a880f9d696e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:49.706197 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cfd2963-dcfb-4b6a-b210-1a880f9d696e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:49.866234 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9cfd2963-dcfb-4b6a-b210-1a880f9d696e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:49.873665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9cfd2963-dcfb-4b6a-b210-1a880f9d696e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.181046 Aug 08 02:26:49.874234 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 122/259] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:49 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:49.891479 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-bdf927d1-6ead-41a4-9f08-40f46c46a1f5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:49.892637 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-bdf927d1-6ead-41a4-9f08-40f46c46a1f5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:49.894672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:49.895676 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=6 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:49.902270 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bdf927d1-6ead-41a4-9f08-40f46c46a1f5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:49.902748 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bdf927d1-6ead-41a4-9f08-40f46c46a1f5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:49.903176 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bdf927d1-6ead-41a4-9f08-40f46c46a1f5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:49.903855 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bdf927d1-6ead-41a4-9f08-40f46c46a1f5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:49.904301 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bdf927d1-6ead-41a4-9f08-40f46c46a1f5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:49.904715 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bdf927d1-6ead-41a4-9f08-40f46c46a1f5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:49.939610 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d7410049-319f-44f7-ad6f-e05ee97a4c2e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:49.940674 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d7410049-319f-44f7-ad6f-e05ee97a4c2e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:49.947694 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7410049-319f-44f7-ad6f-e05ee97a4c2e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:49.948216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7410049-319f-44f7-ad6f-e05ee97a4c2e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:49.948637 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7410049-319f-44f7-ad6f-e05ee97a4c2e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:49.951202 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7410049-319f-44f7-ad6f-e05ee97a4c2e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:49.951666 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7410049-319f-44f7-ad6f-e05ee97a4c2e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:49.952107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7410049-319f-44f7-ad6f-e05ee97a4c2e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:50.007615 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:50.028553 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d7410049-319f-44f7-ad6f-e05ee97a4c2e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:50.032344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:50.037937 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d7410049-319f-44f7-ad6f-e05ee97a4c2e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1272 microversion: 2.1 time: 0.104106 Aug 08 02:26:50.038614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 123/260] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:49 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:50.062489 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-bdf927d1-6ead-41a4-9f08-40f46c46a1f5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:50.070800 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-bdf927d1-6ead-41a4-9f08-40f46c46a1f5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.183198 Aug 08 02:26:50.071365 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 138/261] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:49 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:50.895131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-be23a04a-093c-47fd-b6f0-1d65b14000b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:50.895825 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-be23a04a-093c-47fd-b6f0-1d65b14000b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:50.902722 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:50.904341 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be23a04a-093c-47fd-b6f0-1d65b14000b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:50.905064 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be23a04a-093c-47fd-b6f0-1d65b14000b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:50.905708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be23a04a-093c-47fd-b6f0-1d65b14000b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:50.906732 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be23a04a-093c-47fd-b6f0-1d65b14000b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:50.907405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be23a04a-093c-47fd-b6f0-1d65b14000b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:50.908020 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be23a04a-093c-47fd-b6f0-1d65b14000b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:51.059137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-03674278-4fda-4c2b-aeeb-994ebc39ccfc tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:51.060681 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-03674278-4fda-4c2b-aeeb-994ebc39ccfc tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:51.062620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:26:51.074533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-03674278-4fda-4c2b-aeeb-994ebc39ccfc tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:51.075013 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-03674278-4fda-4c2b-aeeb-994ebc39ccfc tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:51.075720 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-03674278-4fda-4c2b-aeeb-994ebc39ccfc tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:51.076452 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-03674278-4fda-4c2b-aeeb-994ebc39ccfc tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:51.076949 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-03674278-4fda-4c2b-aeeb-994ebc39ccfc tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:51.077368 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-03674278-4fda-4c2b-aeeb-994ebc39ccfc tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:51.159176 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-be23a04a-093c-47fd-b6f0-1d65b14000b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:51.168823 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-be23a04a-093c-47fd-b6f0-1d65b14000b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.277984 Aug 08 02:26:51.169410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 124/262] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:50 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:51.179698 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f11563b2-fbd2-42fb-8c69-70030c24677c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:51.180514 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f11563b2-fbd2-42fb-8c69-70030c24677c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:51.187271 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f11563b2-fbd2-42fb-8c69-70030c24677c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:51.188001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f11563b2-fbd2-42fb-8c69-70030c24677c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:51.188602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f11563b2-fbd2-42fb-8c69-70030c24677c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:51.189553 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f11563b2-fbd2-42fb-8c69-70030c24677c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:51.190164 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f11563b2-fbd2-42fb-8c69-70030c24677c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:51.190613 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f11563b2-fbd2-42fb-8c69-70030c24677c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:51.260712 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-03674278-4fda-4c2b-aeeb-994ebc39ccfc tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:51.271054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-03674278-4fda-4c2b-aeeb-994ebc39ccfc tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.215693 Aug 08 02:26:51.271926 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 139/263] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:51 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:51.351336 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f11563b2-fbd2-42fb-8c69-70030c24677c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:51.359337 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f11563b2-fbd2-42fb-8c69-70030c24677c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.188810 Aug 08 02:26:51.360128 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 125/264] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:51 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:52.188914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e5581133-c9b9-4671-afb5-7cc869b196b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:52.189862 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e5581133-c9b9-4671-afb5-7cc869b196b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:52.196207 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e5581133-c9b9-4671-afb5-7cc869b196b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:52.196763 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e5581133-c9b9-4671-afb5-7cc869b196b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:52.197214 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e5581133-c9b9-4671-afb5-7cc869b196b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:52.197912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e5581133-c9b9-4671-afb5-7cc869b196b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:52.198395 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e5581133-c9b9-4671-afb5-7cc869b196b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:52.198819 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e5581133-c9b9-4671-afb5-7cc869b196b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:52.293803 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-13388ff0-0f57-4c73-8e29-af4baf04f1ae tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:52.294993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-13388ff0-0f57-4c73-8e29-af4baf04f1ae tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:52.302271 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13388ff0-0f57-4c73-8e29-af4baf04f1ae tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:52.302980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13388ff0-0f57-4c73-8e29-af4baf04f1ae tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:52.303713 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13388ff0-0f57-4c73-8e29-af4baf04f1ae tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:52.304822 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13388ff0-0f57-4c73-8e29-af4baf04f1ae tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:52.305481 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13388ff0-0f57-4c73-8e29-af4baf04f1ae tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:52.306053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-13388ff0-0f57-4c73-8e29-af4baf04f1ae tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:52.351888 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e5581133-c9b9-4671-afb5-7cc869b196b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:52.360894 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e5581133-c9b9-4671-afb5-7cc869b196b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.175707 Aug 08 02:26:52.361769 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 140/265] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:52 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:52.380223 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a21cba25-4cc2-40af-8b70-340c5a9f06c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:52.380883 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a21cba25-4cc2-40af-8b70-340c5a9f06c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:52.387243 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a21cba25-4cc2-40af-8b70-340c5a9f06c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:52.387731 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a21cba25-4cc2-40af-8b70-340c5a9f06c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:52.388276 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a21cba25-4cc2-40af-8b70-340c5a9f06c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:52.388847 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a21cba25-4cc2-40af-8b70-340c5a9f06c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:52.389328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a21cba25-4cc2-40af-8b70-340c5a9f06c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:52.389717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a21cba25-4cc2-40af-8b70-340c5a9f06c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:52.494100 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-13388ff0-0f57-4c73-8e29-af4baf04f1ae tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:52.509542 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-13388ff0-0f57-4c73-8e29-af4baf04f1ae tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.220023 Aug 08 02:26:52.510177 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 126/266] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:52 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:52.550406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a21cba25-4cc2-40af-8b70-340c5a9f06c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:52.558711 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a21cba25-4cc2-40af-8b70-340c5a9f06c0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.182423 Aug 08 02:26:52.559277 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 141/267] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:52 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:53.381678 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-af61066f-2dd4-427b-8f00-14108ebc5734 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:53.382349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-af61066f-2dd4-427b-8f00-14108ebc5734 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:53.388666 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-af61066f-2dd4-427b-8f00-14108ebc5734 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:53.389139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-af61066f-2dd4-427b-8f00-14108ebc5734 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:53.389566 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-af61066f-2dd4-427b-8f00-14108ebc5734 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:53.390263 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-af61066f-2dd4-427b-8f00-14108ebc5734 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:53.390710 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-af61066f-2dd4-427b-8f00-14108ebc5734 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:53.391124 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-af61066f-2dd4-427b-8f00-14108ebc5734 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:53.526554 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-af61066f-2dd4-427b-8f00-14108ebc5734 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:53.531205 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6917f395-bae3-4202-9270-9d8d021e3a82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:53.531898 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6917f395-bae3-4202-9270-9d8d021e3a82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:53.534434 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-af61066f-2dd4-427b-8f00-14108ebc5734 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.156510 Aug 08 02:26:53.535180 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 127/268] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:53 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:53.544577 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6917f395-bae3-4202-9270-9d8d021e3a82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:53.545485 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6917f395-bae3-4202-9270-9d8d021e3a82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:53.546048 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6917f395-bae3-4202-9270-9d8d021e3a82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:53.547048 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6917f395-bae3-4202-9270-9d8d021e3a82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:53.547544 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6917f395-bae3-4202-9270-9d8d021e3a82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:53.548261 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6917f395-bae3-4202-9270-9d8d021e3a82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:53.580360 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6ca45168-e721-474e-9c3b-e01558a87c57 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:53.581548 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6ca45168-e721-474e-9c3b-e01558a87c57 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:53.589478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ca45168-e721-474e-9c3b-e01558a87c57 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:53.590145 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ca45168-e721-474e-9c3b-e01558a87c57 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:53.590709 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ca45168-e721-474e-9c3b-e01558a87c57 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:53.591503 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ca45168-e721-474e-9c3b-e01558a87c57 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:53.592061 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ca45168-e721-474e-9c3b-e01558a87c57 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:53.592622 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ca45168-e721-474e-9c3b-e01558a87c57 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:53.694203 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6917f395-bae3-4202-9270-9d8d021e3a82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:53.703358 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6917f395-bae3-4202-9270-9d8d021e3a82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.176050 Aug 08 02:26:53.704110 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 142/269] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:53 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:53.761509 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6ca45168-e721-474e-9c3b-e01558a87c57 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:53.768899 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6ca45168-e721-474e-9c3b-e01558a87c57 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.193366 Aug 08 02:26:53.769471 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 128/270] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:53 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:54.556267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-362e1e69-b9d8-4ad4-b481-024c0e398618 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:54.556933 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-362e1e69-b9d8-4ad4-b481-024c0e398618 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:54.565142 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-362e1e69-b9d8-4ad4-b481-024c0e398618 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:54.565633 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-362e1e69-b9d8-4ad4-b481-024c0e398618 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:54.566080 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-362e1e69-b9d8-4ad4-b481-024c0e398618 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:54.566766 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-362e1e69-b9d8-4ad4-b481-024c0e398618 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:54.567310 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-362e1e69-b9d8-4ad4-b481-024c0e398618 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:54.567642 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-362e1e69-b9d8-4ad4-b481-024c0e398618 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:54.725332 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-64a00ea1-0134-4e8a-a921-faf1470b338a tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:54.726021 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-64a00ea1-0134-4e8a-a921-faf1470b338a tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:54.732926 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64a00ea1-0134-4e8a-a921-faf1470b338a tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:54.733813 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64a00ea1-0134-4e8a-a921-faf1470b338a tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:54.734379 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64a00ea1-0134-4e8a-a921-faf1470b338a tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:54.735331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64a00ea1-0134-4e8a-a921-faf1470b338a tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:54.735912 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64a00ea1-0134-4e8a-a921-faf1470b338a tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:54.736456 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64a00ea1-0134-4e8a-a921-faf1470b338a tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:55.054131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-64a00ea1-0134-4e8a-a921-faf1470b338a tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:55.064583 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-64a00ea1-0134-4e8a-a921-faf1470b338a tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.343092 Aug 08 02:26:55.067611 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 129/271] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:54 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:55.083039 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f396405c-7c5d-46e7-85eb-362339311e40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:55.083867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f396405c-7c5d-46e7-85eb-362339311e40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:55.093855 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f396405c-7c5d-46e7-85eb-362339311e40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:55.098399 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f396405c-7c5d-46e7-85eb-362339311e40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:55.099058 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f396405c-7c5d-46e7-85eb-362339311e40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:55.099973 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f396405c-7c5d-46e7-85eb-362339311e40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:55.101117 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f396405c-7c5d-46e7-85eb-362339311e40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:55.103528 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f396405c-7c5d-46e7-85eb-362339311e40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:55.280898 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-362e1e69-b9d8-4ad4-b481-024c0e398618 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:55.297880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-362e1e69-b9d8-4ad4-b481-024c0e398618 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.745637 Aug 08 02:26:55.312163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 143/272] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:54 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:55.319116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-c19bb597-7b85-4539-a041-e666b51aa4dd req-2a857408-71f1-4638-98ec-88299af8b7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f65c2cae-5950-4951-87eb-74afaf315b13", "tag": "e2682909-d123-436b-8815-168e8604fced"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:55.335861 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-c19bb597-7b85-4539-a041-e666b51aa4dd req-2a857408-71f1-4638-98ec-88299af8b7e2 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:55.337240 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-c19bb597-7b85-4539-a041-e666b51aa4dd req-2a857408-71f1-4638-98ec-88299af8b7e2 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:55.341162 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-c19bb597-7b85-4539-a041-e666b51aa4dd req-2a857408-71f1-4638-98ec-88299af8b7e2 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:55.370687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-c19bb597-7b85-4539-a041-e666b51aa4dd req-2a857408-71f1-4638-98ec-88299af8b7e2 service nova] Creating event network-changed:e2682909-d123-436b-8815-168e8604fced for instance f65c2cae-5950-4951-87eb-74afaf315b13 on hv-cinder-73306 Aug 08 02:26:55.377100 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-c19bb597-7b85-4539-a041-e666b51aa4dd req-2a857408-71f1-4638-98ec-88299af8b7e2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061744 Aug 08 02:26:55.377992 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 144/273] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:55.426022 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f396405c-7c5d-46e7-85eb-362339311e40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:55.434221 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f396405c-7c5d-46e7-85eb-362339311e40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.362921 Aug 08 02:26:55.437358 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 130/274] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:55 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:56.092056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2f972e82-4f87-471c-b577-5750b613e295 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:56.093326 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2f972e82-4f87-471c-b577-5750b613e295 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:56.100057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f972e82-4f87-471c-b577-5750b613e295 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:56.100739 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f972e82-4f87-471c-b577-5750b613e295 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:56.101221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f972e82-4f87-471c-b577-5750b613e295 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:56.102128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f972e82-4f87-471c-b577-5750b613e295 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:56.102768 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f972e82-4f87-471c-b577-5750b613e295 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:56.103343 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f972e82-4f87-471c-b577-5750b613e295 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:56.287028 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2f972e82-4f87-471c-b577-5750b613e295 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:56.295824 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2f972e82-4f87-471c-b577-5750b613e295 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.208116 Aug 08 02:26:56.296395 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 145/275] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:56 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:56.319037 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1cde794d-e00f-4fcd-b9f8-a2243fe0d261 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:56.319653 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1cde794d-e00f-4fcd-b9f8-a2243fe0d261 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:56.327380 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cde794d-e00f-4fcd-b9f8-a2243fe0d261 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:56.328100 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cde794d-e00f-4fcd-b9f8-a2243fe0d261 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:56.328536 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cde794d-e00f-4fcd-b9f8-a2243fe0d261 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:56.329227 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cde794d-e00f-4fcd-b9f8-a2243fe0d261 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:56.329677 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cde794d-e00f-4fcd-b9f8-a2243fe0d261 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:56.330099 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cde794d-e00f-4fcd-b9f8-a2243fe0d261 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:56.460138 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-30abb172-4059-4cd8-8989-8ec95f20316c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:56.460846 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-30abb172-4059-4cd8-8989-8ec95f20316c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:56.467821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-30abb172-4059-4cd8-8989-8ec95f20316c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:56.468385 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-30abb172-4059-4cd8-8989-8ec95f20316c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:56.469041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-30abb172-4059-4cd8-8989-8ec95f20316c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:56.469796 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-30abb172-4059-4cd8-8989-8ec95f20316c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:56.470468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-30abb172-4059-4cd8-8989-8ec95f20316c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:56.471716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-30abb172-4059-4cd8-8989-8ec95f20316c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:56.511618 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1cde794d-e00f-4fcd-b9f8-a2243fe0d261 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:56.527081 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1cde794d-e00f-4fcd-b9f8-a2243fe0d261 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.211785 Aug 08 02:26:56.527974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 131/276] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:56 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:56.648849 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-30abb172-4059-4cd8-8989-8ec95f20316c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:56.657023 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-30abb172-4059-4cd8-8989-8ec95f20316c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.202041 Aug 08 02:26:56.657817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 146/277] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:56 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:56.947239 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-768986aa-4847-4225-9363-d1a187d19f32 req-ca694e7d-681a-4e4d-8fe6-ecb5b548621d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f526af59-111b-48d0-a2aa-b861530026b9", "name": "network-vif-plugged", "status": "completed", "tag": "da5825a9-2610-47e2-97f4-499c5f751915"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:26:56.968908 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-768986aa-4847-4225-9363-d1a187d19f32 req-ca694e7d-681a-4e4d-8fe6-ecb5b548621d service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:56.968908 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-768986aa-4847-4225-9363-d1a187d19f32 req-ca694e7d-681a-4e4d-8fe6-ecb5b548621d service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:56.968908 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-768986aa-4847-4225-9363-d1a187d19f32 req-ca694e7d-681a-4e4d-8fe6-ecb5b548621d service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:56.981914 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-768986aa-4847-4225-9363-d1a187d19f32 req-ca694e7d-681a-4e4d-8fe6-ecb5b548621d service nova] Creating event network-vif-plugged:da5825a9-2610-47e2-97f4-499c5f751915 for instance f526af59-111b-48d0-a2aa-b861530026b9 on hv-cinder-73306 Aug 08 02:26:56.990270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-768986aa-4847-4225-9363-d1a187d19f32 req-ca694e7d-681a-4e4d-8fe6-ecb5b548621d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047785 Aug 08 02:26:56.991374 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 132/278] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:26:57.317860 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dac18d1d-000f-4c61-a0d0-01160014186d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:57.318650 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-dac18d1d-000f-4c61-a0d0-01160014186d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:57.325084 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dac18d1d-000f-4c61-a0d0-01160014186d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:57.325984 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dac18d1d-000f-4c61-a0d0-01160014186d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:57.326568 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dac18d1d-000f-4c61-a0d0-01160014186d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:57.327590 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dac18d1d-000f-4c61-a0d0-01160014186d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:57.328184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dac18d1d-000f-4c61-a0d0-01160014186d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:57.328889 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dac18d1d-000f-4c61-a0d0-01160014186d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:57.514047 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-dac18d1d-000f-4c61-a0d0-01160014186d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:57.522114 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-dac18d1d-000f-4c61-a0d0-01160014186d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.208797 Aug 08 02:26:57.523054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 147/279] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:57 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:57.551498 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fac18607-6cc9-4f4d-80a1-e9e3d8a23b77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:57.553240 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fac18607-6cc9-4f4d-80a1-e9e3d8a23b77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:57.559885 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fac18607-6cc9-4f4d-80a1-e9e3d8a23b77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:57.560576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fac18607-6cc9-4f4d-80a1-e9e3d8a23b77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:57.561011 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fac18607-6cc9-4f4d-80a1-e9e3d8a23b77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:57.561707 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fac18607-6cc9-4f4d-80a1-e9e3d8a23b77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:57.562192 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fac18607-6cc9-4f4d-80a1-e9e3d8a23b77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:57.562641 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fac18607-6cc9-4f4d-80a1-e9e3d8a23b77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:57.683650 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-300afe07-55cc-4cdc-b301-8509d2a3b6a1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:57.685361 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-300afe07-55cc-4cdc-b301-8509d2a3b6a1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:57.694651 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-300afe07-55cc-4cdc-b301-8509d2a3b6a1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:57.695317 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-300afe07-55cc-4cdc-b301-8509d2a3b6a1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:57.696246 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-300afe07-55cc-4cdc-b301-8509d2a3b6a1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:57.696938 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-300afe07-55cc-4cdc-b301-8509d2a3b6a1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:57.697386 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-300afe07-55cc-4cdc-b301-8509d2a3b6a1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:57.698441 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-300afe07-55cc-4cdc-b301-8509d2a3b6a1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:57.708044 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fac18607-6cc9-4f4d-80a1-e9e3d8a23b77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:57.724123 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fac18607-6cc9-4f4d-80a1-e9e3d8a23b77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.176790 Aug 08 02:26:57.738904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 133/280] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:57 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:57.852820 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-300afe07-55cc-4cdc-b301-8509d2a3b6a1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:57.860896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-300afe07-55cc-4cdc-b301-8509d2a3b6a1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.187336 Aug 08 02:26:57.861548 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 148/281] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:57 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:58.543692 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7b69066d-0547-47e1-99b8-6654cc409e91 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:58.544299 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7b69066d-0547-47e1-99b8-6654cc409e91 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:58.550181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b69066d-0547-47e1-99b8-6654cc409e91 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:58.550685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b69066d-0547-47e1-99b8-6654cc409e91 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:58.551113 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b69066d-0547-47e1-99b8-6654cc409e91 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:58.551782 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b69066d-0547-47e1-99b8-6654cc409e91 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:58.552287 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b69066d-0547-47e1-99b8-6654cc409e91 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:58.552624 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b69066d-0547-47e1-99b8-6654cc409e91 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:58.680468 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7b69066d-0547-47e1-99b8-6654cc409e91 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:58.688344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7b69066d-0547-47e1-99b8-6654cc409e91 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.149012 Aug 08 02:26:58.688899 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 134/282] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:58 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:58.751738 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3fbd8e52-5b17-4849-80f8-10a3582dfc9f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:58.752278 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3fbd8e52-5b17-4849-80f8-10a3582dfc9f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:58.758103 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3fbd8e52-5b17-4849-80f8-10a3582dfc9f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:58.758626 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3fbd8e52-5b17-4849-80f8-10a3582dfc9f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:58.759061 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3fbd8e52-5b17-4849-80f8-10a3582dfc9f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:58.759746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3fbd8e52-5b17-4849-80f8-10a3582dfc9f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:58.760197 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3fbd8e52-5b17-4849-80f8-10a3582dfc9f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:58.760621 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3fbd8e52-5b17-4849-80f8-10a3582dfc9f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:58.881221 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-64bbccd4-e930-4bb0-8de4-ece369523e07 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:58.881828 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-64bbccd4-e930-4bb0-8de4-ece369523e07 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:58.887765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64bbccd4-e930-4bb0-8de4-ece369523e07 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:58.888242 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64bbccd4-e930-4bb0-8de4-ece369523e07 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:58.888669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64bbccd4-e930-4bb0-8de4-ece369523e07 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:58.889437 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64bbccd4-e930-4bb0-8de4-ece369523e07 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:58.890090 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64bbccd4-e930-4bb0-8de4-ece369523e07 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:58.890592 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-64bbccd4-e930-4bb0-8de4-ece369523e07 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:58.903080 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3fbd8e52-5b17-4849-80f8-10a3582dfc9f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:58.913578 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3fbd8e52-5b17-4849-80f8-10a3582dfc9f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.165706 Aug 08 02:26:58.914708 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 149/283] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:58 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:59.153876 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-64bbccd4-e930-4bb0-8de4-ece369523e07 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:59.161224 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-64bbccd4-e930-4bb0-8de4-ece369523e07 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.284067 Aug 08 02:26:59.161813 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 135/284] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:58 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:26:59.708817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-59073e97-a5e7-42f2-8910-0fc279d957ec tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:59.709454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-59073e97-a5e7-42f2-8910-0fc279d957ec tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:59.715424 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-59073e97-a5e7-42f2-8910-0fc279d957ec tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:59.715899 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-59073e97-a5e7-42f2-8910-0fc279d957ec tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:59.716329 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-59073e97-a5e7-42f2-8910-0fc279d957ec tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:59.717008 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-59073e97-a5e7-42f2-8910-0fc279d957ec tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:59.717458 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-59073e97-a5e7-42f2-8910-0fc279d957ec tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:59.717878 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-59073e97-a5e7-42f2-8910-0fc279d957ec tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:59.847491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-59073e97-a5e7-42f2-8910-0fc279d957ec tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:26:59.854776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-59073e97-a5e7-42f2-8910-0fc279d957ec tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.149761 Aug 08 02:26:59.855338 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 150/285] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:59 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:26:59.935867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c70e2001-8919-4e85-85ca-a03f55316f45 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:26:59.936456 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c70e2001-8919-4e85-85ca-a03f55316f45 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:26:59.943108 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c70e2001-8919-4e85-85ca-a03f55316f45 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:59.943583 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c70e2001-8919-4e85-85ca-a03f55316f45 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:59.944009 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c70e2001-8919-4e85-85ca-a03f55316f45 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:26:59.944687 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c70e2001-8919-4e85-85ca-a03f55316f45 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:26:59.945133 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c70e2001-8919-4e85-85ca-a03f55316f45 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:26:59.945544 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c70e2001-8919-4e85-85ca-a03f55316f45 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:00.078906 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c70e2001-8919-4e85-85ca-a03f55316f45 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:00.086687 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c70e2001-8919-4e85-85ca-a03f55316f45 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.155123 Aug 08 02:27:00.087262 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 136/286] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:26:59 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:00.184175 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b7e692b6-75f3-4961-ab0c-b8d5935f3cc9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:00.184811 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b7e692b6-75f3-4961-ab0c-b8d5935f3cc9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:00.191091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b7e692b6-75f3-4961-ab0c-b8d5935f3cc9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:00.191495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b7e692b6-75f3-4961-ab0c-b8d5935f3cc9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:00.191923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b7e692b6-75f3-4961-ab0c-b8d5935f3cc9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:00.192603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b7e692b6-75f3-4961-ab0c-b8d5935f3cc9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:00.193049 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b7e692b6-75f3-4961-ab0c-b8d5935f3cc9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:00.193467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b7e692b6-75f3-4961-ab0c-b8d5935f3cc9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:00.319486 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b7e692b6-75f3-4961-ab0c-b8d5935f3cc9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:00.327374 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b7e692b6-75f3-4961-ab0c-b8d5935f3cc9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.147056 Aug 08 02:27:00.327928 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 151/287] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:00 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:00.875123 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-66473653-008f-429f-8d74-6de7c11a8b8f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:00.875735 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-66473653-008f-429f-8d74-6de7c11a8b8f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:00.881591 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-66473653-008f-429f-8d74-6de7c11a8b8f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:00.882070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-66473653-008f-429f-8d74-6de7c11a8b8f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:00.882534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-66473653-008f-429f-8d74-6de7c11a8b8f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:00.883210 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-66473653-008f-429f-8d74-6de7c11a8b8f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:00.883659 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-66473653-008f-429f-8d74-6de7c11a8b8f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:00.884078 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-66473653-008f-429f-8d74-6de7c11a8b8f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:01.012235 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-66473653-008f-429f-8d74-6de7c11a8b8f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:01.019563 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-66473653-008f-429f-8d74-6de7c11a8b8f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.148319 Aug 08 02:27:01.020130 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 137/288] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:00 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:01.108733 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-331e75be-9f5c-472d-a718-fba0c6a726e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:01.109348 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-331e75be-9f5c-472d-a718-fba0c6a726e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:01.115416 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-331e75be-9f5c-472d-a718-fba0c6a726e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:01.115918 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-331e75be-9f5c-472d-a718-fba0c6a726e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:01.116340 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-331e75be-9f5c-472d-a718-fba0c6a726e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:01.117028 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-331e75be-9f5c-472d-a718-fba0c6a726e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:01.117479 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-331e75be-9f5c-472d-a718-fba0c6a726e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:01.117903 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-331e75be-9f5c-472d-a718-fba0c6a726e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:01.247039 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-331e75be-9f5c-472d-a718-fba0c6a726e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:01.254593 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-331e75be-9f5c-472d-a718-fba0c6a726e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.150562 Aug 08 02:27:01.255146 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 152/289] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:01 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:01.347478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-30758dd8-732b-42f5-bc05-d00f5417b955 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:01.348084 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-30758dd8-732b-42f5-bc05-d00f5417b955 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:01.354646 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30758dd8-732b-42f5-bc05-d00f5417b955 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:01.355126 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30758dd8-732b-42f5-bc05-d00f5417b955 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:01.355555 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30758dd8-732b-42f5-bc05-d00f5417b955 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:01.356235 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30758dd8-732b-42f5-bc05-d00f5417b955 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:01.356684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30758dd8-732b-42f5-bc05-d00f5417b955 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:01.357103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30758dd8-732b-42f5-bc05-d00f5417b955 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:01.489118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-30758dd8-732b-42f5-bc05-d00f5417b955 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:01.496620 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-30758dd8-732b-42f5-bc05-d00f5417b955 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.152935 Aug 08 02:27:01.497195 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 138/290] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:01 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:02.039932 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c13c5460-5cfe-4828-b6c1-1af74febddb8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:02.040538 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c13c5460-5cfe-4828-b6c1-1af74febddb8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:02.046548 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c13c5460-5cfe-4828-b6c1-1af74febddb8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:02.047028 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c13c5460-5cfe-4828-b6c1-1af74febddb8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:02.047462 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c13c5460-5cfe-4828-b6c1-1af74febddb8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:02.048142 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c13c5460-5cfe-4828-b6c1-1af74febddb8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:02.048596 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c13c5460-5cfe-4828-b6c1-1af74febddb8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:02.049018 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c13c5460-5cfe-4828-b6c1-1af74febddb8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:02.053072 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:02.182868 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c13c5460-5cfe-4828-b6c1-1af74febddb8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:02.190774 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c13c5460-5cfe-4828-b6c1-1af74febddb8 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.154631 Aug 08 02:27:02.191347 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 153/291] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:02 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:02.275296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-02e2dd7e-4ff1-44c8-b0cc-9673ed2ea245 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:02.276070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-02e2dd7e-4ff1-44c8-b0cc-9673ed2ea245 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:02.282473 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-02e2dd7e-4ff1-44c8-b0cc-9673ed2ea245 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:02.282954 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-02e2dd7e-4ff1-44c8-b0cc-9673ed2ea245 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:02.283386 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-02e2dd7e-4ff1-44c8-b0cc-9673ed2ea245 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:02.284073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-02e2dd7e-4ff1-44c8-b0cc-9673ed2ea245 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:02.284522 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-02e2dd7e-4ff1-44c8-b0cc-9673ed2ea245 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:02.284942 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-02e2dd7e-4ff1-44c8-b0cc-9673ed2ea245 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:02.409617 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-02e2dd7e-4ff1-44c8-b0cc-9673ed2ea245 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:02.420015 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-02e2dd7e-4ff1-44c8-b0cc-9673ed2ea245 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.148436 Aug 08 02:27:02.420601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 139/292] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:02 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:02.516171 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0ab86174-5f55-4012-bcc4-f96c97819c7c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:02.516776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0ab86174-5f55-4012-bcc4-f96c97819c7c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:02.522689 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ab86174-5f55-4012-bcc4-f96c97819c7c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:02.523160 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ab86174-5f55-4012-bcc4-f96c97819c7c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:02.523581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ab86174-5f55-4012-bcc4-f96c97819c7c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:02.524247 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ab86174-5f55-4012-bcc4-f96c97819c7c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:02.524688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ab86174-5f55-4012-bcc4-f96c97819c7c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:02.525099 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ab86174-5f55-4012-bcc4-f96c97819c7c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:02.660172 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0ab86174-5f55-4012-bcc4-f96c97819c7c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:02.668203 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0ab86174-5f55-4012-bcc4-f96c97819c7c tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.155780 Aug 08 02:27:02.668771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 154/293] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:02 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:03.212685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2156162a-9d59-44c6-8a94-157c0b110d2b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:03.214090 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2156162a-9d59-44c6-8a94-157c0b110d2b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:03.220061 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2156162a-9d59-44c6-8a94-157c0b110d2b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:03.220641 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2156162a-9d59-44c6-8a94-157c0b110d2b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:03.221074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2156162a-9d59-44c6-8a94-157c0b110d2b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:03.221789 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2156162a-9d59-44c6-8a94-157c0b110d2b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:03.222242 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2156162a-9d59-44c6-8a94-157c0b110d2b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:03.222693 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2156162a-9d59-44c6-8a94-157c0b110d2b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:03.350173 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2156162a-9d59-44c6-8a94-157c0b110d2b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:03.357488 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2156162a-9d59-44c6-8a94-157c0b110d2b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.148633 Aug 08 02:27:03.358063 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 140/294] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:03 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:03.441193 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3d71092b-5402-4e15-a3ca-c86b2f5291b8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:03.441730 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3d71092b-5402-4e15-a3ca-c86b2f5291b8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:03.448267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3d71092b-5402-4e15-a3ca-c86b2f5291b8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:03.448724 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3d71092b-5402-4e15-a3ca-c86b2f5291b8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:03.449148 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3d71092b-5402-4e15-a3ca-c86b2f5291b8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:03.449820 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3d71092b-5402-4e15-a3ca-c86b2f5291b8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:03.450278 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3d71092b-5402-4e15-a3ca-c86b2f5291b8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:03.450697 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3d71092b-5402-4e15-a3ca-c86b2f5291b8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:03.581700 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3d71092b-5402-4e15-a3ca-c86b2f5291b8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:03.589363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3d71092b-5402-4e15-a3ca-c86b2f5291b8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.152295 Aug 08 02:27:03.589925 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 155/295] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:03 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:03.688775 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dadfa4d6-b005-4faa-9417-213827d36676 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:03.689658 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dadfa4d6-b005-4faa-9417-213827d36676 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:03.695630 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dadfa4d6-b005-4faa-9417-213827d36676 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:03.696057 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dadfa4d6-b005-4faa-9417-213827d36676 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:03.696491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dadfa4d6-b005-4faa-9417-213827d36676 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:03.697178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dadfa4d6-b005-4faa-9417-213827d36676 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:03.698285 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dadfa4d6-b005-4faa-9417-213827d36676 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:03.698712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dadfa4d6-b005-4faa-9417-213827d36676 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:03.702676 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:03.824217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dadfa4d6-b005-4faa-9417-213827d36676 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:03.831564 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dadfa4d6-b005-4faa-9417-213827d36676 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.146531 Aug 08 02:27:03.832131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 141/296] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:03 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:04.378537 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0099e3f9-c10e-4b22-869d-aa87c08dcb4e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:04.379170 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0099e3f9-c10e-4b22-869d-aa87c08dcb4e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:04.385057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0099e3f9-c10e-4b22-869d-aa87c08dcb4e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:04.385546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0099e3f9-c10e-4b22-869d-aa87c08dcb4e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:04.385974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0099e3f9-c10e-4b22-869d-aa87c08dcb4e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:04.386669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0099e3f9-c10e-4b22-869d-aa87c08dcb4e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:04.387107 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0099e3f9-c10e-4b22-869d-aa87c08dcb4e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:04.387524 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0099e3f9-c10e-4b22-869d-aa87c08dcb4e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:04.515224 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0099e3f9-c10e-4b22-869d-aa87c08dcb4e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:04.522615 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0099e3f9-c10e-4b22-869d-aa87c08dcb4e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.147844 Aug 08 02:27:04.523172 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 156/297] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:04 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:04.611008 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d067aa2b-f8f5-4f00-ae46-eea4d5a2d925 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:04.611623 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d067aa2b-f8f5-4f00-ae46-eea4d5a2d925 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:04.618466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d067aa2b-f8f5-4f00-ae46-eea4d5a2d925 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:04.618950 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d067aa2b-f8f5-4f00-ae46-eea4d5a2d925 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:04.619383 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d067aa2b-f8f5-4f00-ae46-eea4d5a2d925 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:04.620076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d067aa2b-f8f5-4f00-ae46-eea4d5a2d925 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:04.620531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d067aa2b-f8f5-4f00-ae46-eea4d5a2d925 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:04.620954 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d067aa2b-f8f5-4f00-ae46-eea4d5a2d925 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:04.762397 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d067aa2b-f8f5-4f00-ae46-eea4d5a2d925 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:04.771074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d067aa2b-f8f5-4f00-ae46-eea4d5a2d925 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.164109 Aug 08 02:27:04.771860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 142/298] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:04 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:04.852914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2bbff2b3-f441-4b98-b85e-5ea52b104ec4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:04.853522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2bbff2b3-f441-4b98-b85e-5ea52b104ec4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:04.860856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2bbff2b3-f441-4b98-b85e-5ea52b104ec4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:04.861353 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2bbff2b3-f441-4b98-b85e-5ea52b104ec4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:04.861763 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2bbff2b3-f441-4b98-b85e-5ea52b104ec4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:04.862475 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2bbff2b3-f441-4b98-b85e-5ea52b104ec4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:04.862920 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2bbff2b3-f441-4b98-b85e-5ea52b104ec4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:04.863332 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2bbff2b3-f441-4b98-b85e-5ea52b104ec4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:04.999133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2bbff2b3-f441-4b98-b85e-5ea52b104ec4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:05.007013 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2bbff2b3-f441-4b98-b85e-5ea52b104ec4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.158013 Aug 08 02:27:05.007586 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 157/299] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:04 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:05.544176 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a691a5f5-2b13-4f61-9d0e-6cdfa8195298 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:05.544807 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a691a5f5-2b13-4f61-9d0e-6cdfa8195298 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:05.550610 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a691a5f5-2b13-4f61-9d0e-6cdfa8195298 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:05.551090 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a691a5f5-2b13-4f61-9d0e-6cdfa8195298 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:05.551517 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a691a5f5-2b13-4f61-9d0e-6cdfa8195298 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:05.552198 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a691a5f5-2b13-4f61-9d0e-6cdfa8195298 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:05.553032 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a691a5f5-2b13-4f61-9d0e-6cdfa8195298 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:05.553459 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a691a5f5-2b13-4f61-9d0e-6cdfa8195298 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:05.795859 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2f9a5989-3c39-4989-8b19-66fe53eea4cd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:05.796467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2f9a5989-3c39-4989-8b19-66fe53eea4cd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:05.802444 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f9a5989-3c39-4989-8b19-66fe53eea4cd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:05.802923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f9a5989-3c39-4989-8b19-66fe53eea4cd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:05.803349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f9a5989-3c39-4989-8b19-66fe53eea4cd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:05.804031 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f9a5989-3c39-4989-8b19-66fe53eea4cd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:05.804472 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f9a5989-3c39-4989-8b19-66fe53eea4cd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:05.804889 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f9a5989-3c39-4989-8b19-66fe53eea4cd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:05.879216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a691a5f5-2b13-4f61-9d0e-6cdfa8195298 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:05.887285 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a691a5f5-2b13-4f61-9d0e-6cdfa8195298 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.347330 Aug 08 02:27:05.888183 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 143/300] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:05 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:05.939871 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2f9a5989-3c39-4989-8b19-66fe53eea4cd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:05.948056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2f9a5989-3c39-4989-8b19-66fe53eea4cd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.156222 Aug 08 02:27:05.948619 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 158/301] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:05 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:06.030216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e4f15dfc-07c0-4ad1-8f39-cad2899064df tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:06.030962 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e4f15dfc-07c0-4ad1-8f39-cad2899064df tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:06.037016 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4f15dfc-07c0-4ad1-8f39-cad2899064df tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:06.037574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4f15dfc-07c0-4ad1-8f39-cad2899064df tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:06.038096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4f15dfc-07c0-4ad1-8f39-cad2899064df tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:06.039698 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4f15dfc-07c0-4ad1-8f39-cad2899064df tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:06.040612 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4f15dfc-07c0-4ad1-8f39-cad2899064df tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:06.041110 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4f15dfc-07c0-4ad1-8f39-cad2899064df tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:06.195176 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e4f15dfc-07c0-4ad1-8f39-cad2899064df tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:06.203507 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e4f15dfc-07c0-4ad1-8f39-cad2899064df tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.178399 Aug 08 02:27:06.204102 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 144/302] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:06 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:06.908978 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-db3be5c8-2b78-49b2-bcda-dea593087b82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:06.909595 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-db3be5c8-2b78-49b2-bcda-dea593087b82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:06.915616 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-db3be5c8-2b78-49b2-bcda-dea593087b82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:06.916093 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-db3be5c8-2b78-49b2-bcda-dea593087b82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:06.917011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-db3be5c8-2b78-49b2-bcda-dea593087b82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:06.917690 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-db3be5c8-2b78-49b2-bcda-dea593087b82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:06.918138 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-db3be5c8-2b78-49b2-bcda-dea593087b82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:06.918589 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-db3be5c8-2b78-49b2-bcda-dea593087b82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:06.968628 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8ce4e200-4497-46c1-aef1-07888e7bb11d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:06.969331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8ce4e200-4497-46c1-aef1-07888e7bb11d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:06.975898 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ce4e200-4497-46c1-aef1-07888e7bb11d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:06.976846 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ce4e200-4497-46c1-aef1-07888e7bb11d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:06.977388 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ce4e200-4497-46c1-aef1-07888e7bb11d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:06.978157 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ce4e200-4497-46c1-aef1-07888e7bb11d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:06.978644 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ce4e200-4497-46c1-aef1-07888e7bb11d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:06.979560 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ce4e200-4497-46c1-aef1-07888e7bb11d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:07.046218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-db3be5c8-2b78-49b2-bcda-dea593087b82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:07.053859 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-db3be5c8-2b78-49b2-bcda-dea593087b82 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.148875 Aug 08 02:27:07.054466 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 159/303] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:06 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:07.106083 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ce4e200-4497-46c1-aef1-07888e7bb11d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:07.113430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8ce4e200-4497-46c1-aef1-07888e7bb11d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.148625 Aug 08 02:27:07.113994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 145/304] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:06 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:07.224625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4dbb33cd-7d80-4aaf-b82e-c26c87b0cf24 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:07.225241 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4dbb33cd-7d80-4aaf-b82e-c26c87b0cf24 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:07.231714 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4dbb33cd-7d80-4aaf-b82e-c26c87b0cf24 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:07.232191 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4dbb33cd-7d80-4aaf-b82e-c26c87b0cf24 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:07.232624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4dbb33cd-7d80-4aaf-b82e-c26c87b0cf24 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:07.233326 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4dbb33cd-7d80-4aaf-b82e-c26c87b0cf24 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:07.233775 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4dbb33cd-7d80-4aaf-b82e-c26c87b0cf24 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:07.234198 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4dbb33cd-7d80-4aaf-b82e-c26c87b0cf24 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:07.360255 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4dbb33cd-7d80-4aaf-b82e-c26c87b0cf24 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:07.367661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4dbb33cd-7d80-4aaf-b82e-c26c87b0cf24 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.146797 Aug 08 02:27:07.368240 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 160/305] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:07 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:08.075177 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0ffc2659-9914-47ce-a4b9-ad49923ce0e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:08.075867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0ffc2659-9914-47ce-a4b9-ad49923ce0e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:08.082096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ffc2659-9914-47ce-a4b9-ad49923ce0e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:08.082599 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ffc2659-9914-47ce-a4b9-ad49923ce0e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:08.083030 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ffc2659-9914-47ce-a4b9-ad49923ce0e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:08.083704 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ffc2659-9914-47ce-a4b9-ad49923ce0e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:08.084149 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ffc2659-9914-47ce-a4b9-ad49923ce0e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:08.084558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ffc2659-9914-47ce-a4b9-ad49923ce0e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:08.132982 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1b43f8ea-59a0-485a-b834-2aaa50de0df6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:08.133810 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1b43f8ea-59a0-485a-b834-2aaa50de0df6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:08.139772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1b43f8ea-59a0-485a-b834-2aaa50de0df6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:08.140359 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1b43f8ea-59a0-485a-b834-2aaa50de0df6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:08.140861 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1b43f8ea-59a0-485a-b834-2aaa50de0df6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:08.141643 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1b43f8ea-59a0-485a-b834-2aaa50de0df6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:08.142169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1b43f8ea-59a0-485a-b834-2aaa50de0df6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:08.142678 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1b43f8ea-59a0-485a-b834-2aaa50de0df6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:08.225954 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0ffc2659-9914-47ce-a4b9-ad49923ce0e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:08.233407 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0ffc2659-9914-47ce-a4b9-ad49923ce0e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.162039 Aug 08 02:27:08.233983 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 146/306] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:08 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:08.276232 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1b43f8ea-59a0-485a-b834-2aaa50de0df6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:08.283753 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1b43f8ea-59a0-485a-b834-2aaa50de0df6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.154583 Aug 08 02:27:08.284310 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 161/307] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:08 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:08.388576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-736d9cae-2590-46c2-962a-da78b6409997 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:08.389121 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-736d9cae-2590-46c2-962a-da78b6409997 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:08.394990 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-736d9cae-2590-46c2-962a-da78b6409997 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:08.395470 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-736d9cae-2590-46c2-962a-da78b6409997 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:08.395905 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-736d9cae-2590-46c2-962a-da78b6409997 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:08.396586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-736d9cae-2590-46c2-962a-da78b6409997 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:08.397040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-736d9cae-2590-46c2-962a-da78b6409997 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:08.397462 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-736d9cae-2590-46c2-962a-da78b6409997 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:08.522465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-736d9cae-2590-46c2-962a-da78b6409997 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:08.530665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-736d9cae-2590-46c2-962a-da78b6409997 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.146403 Aug 08 02:27:08.531232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 147/308] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:08 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:09.253257 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4dafbfb4-ce39-4625-916a-6f6033178b81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:09.253870 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4dafbfb4-ce39-4625-916a-6f6033178b81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:09.259828 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4dafbfb4-ce39-4625-916a-6f6033178b81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:09.260320 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4dafbfb4-ce39-4625-916a-6f6033178b81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:09.260749 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4dafbfb4-ce39-4625-916a-6f6033178b81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:09.261452 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4dafbfb4-ce39-4625-916a-6f6033178b81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:09.261901 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4dafbfb4-ce39-4625-916a-6f6033178b81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:09.262352 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4dafbfb4-ce39-4625-916a-6f6033178b81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:09.304532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a6037a94-9800-46a3-9bc8-bbe30965596d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:09.305136 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a6037a94-9800-46a3-9bc8-bbe30965596d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:09.312207 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6037a94-9800-46a3-9bc8-bbe30965596d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:09.312684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6037a94-9800-46a3-9bc8-bbe30965596d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:09.313111 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6037a94-9800-46a3-9bc8-bbe30965596d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:09.313788 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6037a94-9800-46a3-9bc8-bbe30965596d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:09.314505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6037a94-9800-46a3-9bc8-bbe30965596d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:09.314922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6037a94-9800-46a3-9bc8-bbe30965596d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:09.389570 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4dafbfb4-ce39-4625-916a-6f6033178b81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:09.396908 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4dafbfb4-ce39-4625-916a-6f6033178b81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.147436 Aug 08 02:27:09.397474 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 162/309] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:09 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:09.450114 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a6037a94-9800-46a3-9bc8-bbe30965596d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:09.461174 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a6037a94-9800-46a3-9bc8-bbe30965596d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.160219 Aug 08 02:27:09.462011 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 148/310] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:09 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:09.550856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-305edf0c-f740-403c-9e9b-a638dde16102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:09.551477 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-305edf0c-f740-403c-9e9b-a638dde16102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:09.557838 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-305edf0c-f740-403c-9e9b-a638dde16102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:09.558335 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-305edf0c-f740-403c-9e9b-a638dde16102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:09.558762 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-305edf0c-f740-403c-9e9b-a638dde16102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:09.559436 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-305edf0c-f740-403c-9e9b-a638dde16102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:09.559882 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-305edf0c-f740-403c-9e9b-a638dde16102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:09.560303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-305edf0c-f740-403c-9e9b-a638dde16102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:09.690223 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-305edf0c-f740-403c-9e9b-a638dde16102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:09.698163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-305edf0c-f740-403c-9e9b-a638dde16102 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.150503 Aug 08 02:27:09.698688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 163/311] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:09 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:10.418128 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-756171e4-2a7c-4161-b69e-5340cd145d19 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:10.418766 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-756171e4-2a7c-4161-b69e-5340cd145d19 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:10.425145 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-756171e4-2a7c-4161-b69e-5340cd145d19 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:10.425626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-756171e4-2a7c-4161-b69e-5340cd145d19 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:10.426044 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-756171e4-2a7c-4161-b69e-5340cd145d19 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:10.426742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-756171e4-2a7c-4161-b69e-5340cd145d19 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:10.427193 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-756171e4-2a7c-4161-b69e-5340cd145d19 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:10.427604 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-756171e4-2a7c-4161-b69e-5340cd145d19 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:10.488758 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-66426566-9956-468e-9dcc-6298f6c3d8ba tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:10.489367 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-66426566-9956-468e-9dcc-6298f6c3d8ba tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:10.495606 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-66426566-9956-468e-9dcc-6298f6c3d8ba tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:10.496023 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-66426566-9956-468e-9dcc-6298f6c3d8ba tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:10.496451 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-66426566-9956-468e-9dcc-6298f6c3d8ba tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:10.497127 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-66426566-9956-468e-9dcc-6298f6c3d8ba tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:10.497574 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-66426566-9956-468e-9dcc-6298f6c3d8ba tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:10.497984 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-66426566-9956-468e-9dcc-6298f6c3d8ba tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:10.554430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-756171e4-2a7c-4161-b69e-5340cd145d19 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:10.562431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-756171e4-2a7c-4161-b69e-5340cd145d19 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.148561 Aug 08 02:27:10.563410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 149/312] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:10 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:10.627174 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-66426566-9956-468e-9dcc-6298f6c3d8ba tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:10.634711 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-66426566-9956-468e-9dcc-6298f6c3d8ba tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.149710 Aug 08 02:27:10.635823 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 164/313] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:10 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:10.718906 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-628f8607-b9b9-4cde-8a17-5e4387efca76 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:10.719516 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-628f8607-b9b9-4cde-8a17-5e4387efca76 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:10.725321 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-628f8607-b9b9-4cde-8a17-5e4387efca76 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:10.725797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-628f8607-b9b9-4cde-8a17-5e4387efca76 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:10.726226 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-628f8607-b9b9-4cde-8a17-5e4387efca76 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:10.726923 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-628f8607-b9b9-4cde-8a17-5e4387efca76 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:10.727373 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-628f8607-b9b9-4cde-8a17-5e4387efca76 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:10.727788 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-628f8607-b9b9-4cde-8a17-5e4387efca76 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:10.856565 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-628f8607-b9b9-4cde-8a17-5e4387efca76 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:10.863904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-628f8607-b9b9-4cde-8a17-5e4387efca76 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.148792 Aug 08 02:27:10.864467 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 150/314] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:10 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:11.584477 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ef8f4f55-fc6d-4cae-8b5d-aefd6b30b1ee tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:11.585109 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ef8f4f55-fc6d-4cae-8b5d-aefd6b30b1ee tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:11.591520 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ef8f4f55-fc6d-4cae-8b5d-aefd6b30b1ee tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:11.592020 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ef8f4f55-fc6d-4cae-8b5d-aefd6b30b1ee tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:11.592448 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ef8f4f55-fc6d-4cae-8b5d-aefd6b30b1ee tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:11.593123 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ef8f4f55-fc6d-4cae-8b5d-aefd6b30b1ee tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:11.593573 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ef8f4f55-fc6d-4cae-8b5d-aefd6b30b1ee tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:11.593997 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ef8f4f55-fc6d-4cae-8b5d-aefd6b30b1ee tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:11.658107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-70727bdc-dcae-4cdd-ade0-f297698521f9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:11.658784 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-70727bdc-dcae-4cdd-ade0-f297698521f9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:11.665668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70727bdc-dcae-4cdd-ade0-f297698521f9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:11.666921 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70727bdc-dcae-4cdd-ade0-f297698521f9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:11.667619 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70727bdc-dcae-4cdd-ade0-f297698521f9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:11.668442 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70727bdc-dcae-4cdd-ade0-f297698521f9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:11.668907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70727bdc-dcae-4cdd-ade0-f297698521f9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:11.669351 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70727bdc-dcae-4cdd-ade0-f297698521f9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:11.736643 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ef8f4f55-fc6d-4cae-8b5d-aefd6b30b1ee tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:11.746309 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ef8f4f55-fc6d-4cae-8b5d-aefd6b30b1ee tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.165496 Aug 08 02:27:11.746998 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 165/315] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:11 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:11.817673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-70727bdc-dcae-4cdd-ade0-f297698521f9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:11.826811 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-70727bdc-dcae-4cdd-ade0-f297698521f9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.173885 Aug 08 02:27:11.841599 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 151/316] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:11 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:11.859400 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-5012ac94-2eb1-4e38-b20a-ea3fd4089972 req-1aab3e3c-d9fb-4003-87a9-201f42c6eb0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65c2cae-5950-4951-87eb-74afaf315b13", "name": "network-vif-plugged", "status": "completed", "tag": "e2682909-d123-436b-8815-168e8604fced"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:27:11.869116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-5012ac94-2eb1-4e38-b20a-ea3fd4089972 req-1aab3e3c-d9fb-4003-87a9-201f42c6eb0f service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:11.869592 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-5012ac94-2eb1-4e38-b20a-ea3fd4089972 req-1aab3e3c-d9fb-4003-87a9-201f42c6eb0f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:11.870018 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-5012ac94-2eb1-4e38-b20a-ea3fd4089972 req-1aab3e3c-d9fb-4003-87a9-201f42c6eb0f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:11.883184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-5012ac94-2eb1-4e38-b20a-ea3fd4089972 req-1aab3e3c-d9fb-4003-87a9-201f42c6eb0f service nova] Creating event network-vif-plugged:e2682909-d123-436b-8815-168e8604fced for instance f65c2cae-5950-4951-87eb-74afaf315b13 on hv-cinder-73306 Aug 08 02:27:11.884595 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2b59ca59-b9fc-4620-b736-706d8aa61840 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:11.885415 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2b59ca59-b9fc-4620-b736-706d8aa61840 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:11.888293 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-5012ac94-2eb1-4e38-b20a-ea3fd4089972 req-1aab3e3c-d9fb-4003-87a9-201f42c6eb0f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032642 Aug 08 02:27:11.889065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 166/317] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:27:11.891326 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b59ca59-b9fc-4620-b736-706d8aa61840 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:11.891802 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b59ca59-b9fc-4620-b736-706d8aa61840 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:11.892224 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b59ca59-b9fc-4620-b736-706d8aa61840 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:11.892904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b59ca59-b9fc-4620-b736-706d8aa61840 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:11.893347 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b59ca59-b9fc-4620-b736-706d8aa61840 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:11.893759 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b59ca59-b9fc-4620-b736-706d8aa61840 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:12.023272 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2b59ca59-b9fc-4620-b736-706d8aa61840 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:12.031264 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2b59ca59-b9fc-4620-b736-706d8aa61840 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.150476 Aug 08 02:27:12.031836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 152/318] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:11 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:12.769440 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-13aa6879-0545-48b2-9227-2c4471d31afa tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:12.770133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-13aa6879-0545-48b2-9227-2c4471d31afa tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:12.776383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13aa6879-0545-48b2-9227-2c4471d31afa tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:12.776862 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13aa6879-0545-48b2-9227-2c4471d31afa tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:12.777292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13aa6879-0545-48b2-9227-2c4471d31afa tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:12.777984 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13aa6879-0545-48b2-9227-2c4471d31afa tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:12.778491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13aa6879-0545-48b2-9227-2c4471d31afa tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:12.778893 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13aa6879-0545-48b2-9227-2c4471d31afa tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:12.849160 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-06f2e58b-33da-4154-8d0e-a1f2c9ba7d5a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:12.849882 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-06f2e58b-33da-4154-8d0e-a1f2c9ba7d5a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:12.856360 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06f2e58b-33da-4154-8d0e-a1f2c9ba7d5a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:12.856833 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06f2e58b-33da-4154-8d0e-a1f2c9ba7d5a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:12.857325 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06f2e58b-33da-4154-8d0e-a1f2c9ba7d5a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:12.858073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06f2e58b-33da-4154-8d0e-a1f2c9ba7d5a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:12.858611 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06f2e58b-33da-4154-8d0e-a1f2c9ba7d5a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:12.859113 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06f2e58b-33da-4154-8d0e-a1f2c9ba7d5a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:12.919985 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-13aa6879-0545-48b2-9227-2c4471d31afa tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:12.927517 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-13aa6879-0545-48b2-9227-2c4471d31afa tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.162344 Aug 08 02:27:12.928077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 167/319] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:12 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:12.988952 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-06f2e58b-33da-4154-8d0e-a1f2c9ba7d5a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:12.997027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-06f2e58b-33da-4154-8d0e-a1f2c9ba7d5a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.151890 Aug 08 02:27:12.997597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 153/320] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:12 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:13.051647 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3c0cc4b6-eb01-441d-b499-9f46e9f41949 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:13.052532 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3c0cc4b6-eb01-441d-b499-9f46e9f41949 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:13.059387 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c0cc4b6-eb01-441d-b499-9f46e9f41949 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:13.060068 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c0cc4b6-eb01-441d-b499-9f46e9f41949 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:13.060844 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c0cc4b6-eb01-441d-b499-9f46e9f41949 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:13.061679 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c0cc4b6-eb01-441d-b499-9f46e9f41949 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:13.062491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c0cc4b6-eb01-441d-b499-9f46e9f41949 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:13.062914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c0cc4b6-eb01-441d-b499-9f46e9f41949 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:13.216749 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3c0cc4b6-eb01-441d-b499-9f46e9f41949 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:13.222818 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-632a24e8-26fb-41e8-b1f2-9eda3ac4b72e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:13.223347 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-632a24e8-26fb-41e8-b1f2-9eda3ac4b72e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:13.224443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3c0cc4b6-eb01-441d-b499-9f46e9f41949 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1313 microversion: 2.1 time: 0.176720 Aug 08 02:27:13.225188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 168/321] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:13 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:13.230091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-632a24e8-26fb-41e8-b1f2-9eda3ac4b72e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:13.230604 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-632a24e8-26fb-41e8-b1f2-9eda3ac4b72e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:13.231041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-632a24e8-26fb-41e8-b1f2-9eda3ac4b72e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:13.231732 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-632a24e8-26fb-41e8-b1f2-9eda3ac4b72e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:13.232187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-632a24e8-26fb-41e8-b1f2-9eda3ac4b72e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:13.232616 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-632a24e8-26fb-41e8-b1f2-9eda3ac4b72e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:13.258791 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-632a24e8-26fb-41e8-b1f2-9eda3ac4b72e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:27:13.340607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-632a24e8-26fb-41e8-b1f2-9eda3ac4b72e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 204 len: 0 microversion: 2.1 time: 0.121485 Aug 08 02:27:13.341220 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 154/322] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:27:13 2022] DELETE /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:27:13.349179 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-79465ee4-84aa-488a-958e-f44dad8e1f5e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:13.349792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-79465ee4-84aa-488a-958e-f44dad8e1f5e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:13.356216 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-79465ee4-84aa-488a-958e-f44dad8e1f5e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:13.356693 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-79465ee4-84aa-488a-958e-f44dad8e1f5e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:13.357180 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-79465ee4-84aa-488a-958e-f44dad8e1f5e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:13.357841 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-79465ee4-84aa-488a-958e-f44dad8e1f5e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:13.358316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-79465ee4-84aa-488a-958e-f44dad8e1f5e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:13.358737 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-79465ee4-84aa-488a-958e-f44dad8e1f5e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:13.490972 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-79465ee4-84aa-488a-958e-f44dad8e1f5e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:13.498890 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-79465ee4-84aa-488a-958e-f44dad8e1f5e tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.153569 Aug 08 02:27:13.499451 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 169/323] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:13 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:13.950195 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5e229312-444f-444e-b18c-0e108099ec7e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:13.950940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5e229312-444f-444e-b18c-0e108099ec7e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:13.957281 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e229312-444f-444e-b18c-0e108099ec7e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:13.957755 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e229312-444f-444e-b18c-0e108099ec7e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:13.958183 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e229312-444f-444e-b18c-0e108099ec7e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:13.958889 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e229312-444f-444e-b18c-0e108099ec7e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:13.959334 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e229312-444f-444e-b18c-0e108099ec7e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:13.959752 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e229312-444f-444e-b18c-0e108099ec7e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:14.017159 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6d530bda-3dda-4783-9751-e201b1674cf1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:14.017765 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6d530bda-3dda-4783-9751-e201b1674cf1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:14.024056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6d530bda-3dda-4783-9751-e201b1674cf1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:14.024678 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6d530bda-3dda-4783-9751-e201b1674cf1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:14.025115 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6d530bda-3dda-4783-9751-e201b1674cf1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:14.025856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6d530bda-3dda-4783-9751-e201b1674cf1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:14.026357 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6d530bda-3dda-4783-9751-e201b1674cf1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:14.026777 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6d530bda-3dda-4783-9751-e201b1674cf1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:14.044750 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:14.160523 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6d530bda-3dda-4783-9751-e201b1674cf1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:14.168620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6d530bda-3dda-4783-9751-e201b1674cf1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.155292 Aug 08 02:27:14.169261 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 170/324] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:14 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:14.246020 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d6b06001-0dc2-46c8-ba29-0e3c161943f1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:14.246748 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d6b06001-0dc2-46c8-ba29-0e3c161943f1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:14.252981 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d6b06001-0dc2-46c8-ba29-0e3c161943f1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:14.253555 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d6b06001-0dc2-46c8-ba29-0e3c161943f1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:14.253980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d6b06001-0dc2-46c8-ba29-0e3c161943f1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:14.254690 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d6b06001-0dc2-46c8-ba29-0e3c161943f1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:14.255135 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d6b06001-0dc2-46c8-ba29-0e3c161943f1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:14.255548 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d6b06001-0dc2-46c8-ba29-0e3c161943f1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:14.313551 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5e229312-444f-444e-b18c-0e108099ec7e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:14.321276 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5e229312-444f-444e-b18c-0e108099ec7e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.375922 Aug 08 02:27:14.321851 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 155/325] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:13 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:14.386306 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d6b06001-0dc2-46c8-ba29-0e3c161943f1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:14.393624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d6b06001-0dc2-46c8-ba29-0e3c161943f1 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1498 microversion: 2.1 time: 0.152224 Aug 08 02:27:14.394171 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 171/326] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:14 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:14.518874 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4811758b-bbf3-466a-ba3b-25d72e321c7a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:14.519480 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4811758b-bbf3-466a-ba3b-25d72e321c7a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:14.525261 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4811758b-bbf3-466a-ba3b-25d72e321c7a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:14.525736 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4811758b-bbf3-466a-ba3b-25d72e321c7a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:14.526162 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4811758b-bbf3-466a-ba3b-25d72e321c7a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:14.526859 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4811758b-bbf3-466a-ba3b-25d72e321c7a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:14.527303 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4811758b-bbf3-466a-ba3b-25d72e321c7a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:14.527716 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4811758b-bbf3-466a-ba3b-25d72e321c7a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:14.531719 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:14.654570 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4811758b-bbf3-466a-ba3b-25d72e321c7a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:14.662429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4811758b-bbf3-466a-ba3b-25d72e321c7a tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.147323 Aug 08 02:27:14.662992 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 156/327] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:14 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:15.189799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-253aa40f-7175-44e0-91cb-379633cf2b05 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:15.190443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-253aa40f-7175-44e0-91cb-379633cf2b05 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:15.196716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-253aa40f-7175-44e0-91cb-379633cf2b05 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:15.197196 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-253aa40f-7175-44e0-91cb-379633cf2b05 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:15.198116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-253aa40f-7175-44e0-91cb-379633cf2b05 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:15.198823 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-253aa40f-7175-44e0-91cb-379633cf2b05 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:15.199274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-253aa40f-7175-44e0-91cb-379633cf2b05 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:15.199693 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-253aa40f-7175-44e0-91cb-379633cf2b05 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:15.327742 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-253aa40f-7175-44e0-91cb-379633cf2b05 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:15.335144 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-253aa40f-7175-44e0-91cb-379633cf2b05 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.149471 Aug 08 02:27:15.335898 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 172/328] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:15 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:15.342721 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a2fdc9de-f06e-4968-9db5-eabd4556d17f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:15.343680 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a2fdc9de-f06e-4968-9db5-eabd4556d17f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:15.350026 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a2fdc9de-f06e-4968-9db5-eabd4556d17f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:15.350533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a2fdc9de-f06e-4968-9db5-eabd4556d17f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:15.350967 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a2fdc9de-f06e-4968-9db5-eabd4556d17f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:15.351662 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a2fdc9de-f06e-4968-9db5-eabd4556d17f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:15.352113 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a2fdc9de-f06e-4968-9db5-eabd4556d17f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:15.352537 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a2fdc9de-f06e-4968-9db5-eabd4556d17f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:15.481860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a2fdc9de-f06e-4968-9db5-eabd4556d17f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:15.489181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a2fdc9de-f06e-4968-9db5-eabd4556d17f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.151037 Aug 08 02:27:15.489740 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 157/329] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:15 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:15.683925 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-38da089b-d68f-4f49-aa65-c05af5e47706 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:15.684476 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-38da089b-d68f-4f49-aa65-c05af5e47706 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:15.690533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-38da089b-d68f-4f49-aa65-c05af5e47706 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:15.691007 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-38da089b-d68f-4f49-aa65-c05af5e47706 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:15.691432 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-38da089b-d68f-4f49-aa65-c05af5e47706 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:15.692104 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-38da089b-d68f-4f49-aa65-c05af5e47706 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:15.692547 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-38da089b-d68f-4f49-aa65-c05af5e47706 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:15.692961 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-38da089b-d68f-4f49-aa65-c05af5e47706 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:15.818488 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-38da089b-d68f-4f49-aa65-c05af5e47706 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:15.826574 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-38da089b-d68f-4f49-aa65-c05af5e47706 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.146970 Aug 08 02:27:15.827120 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 173/330] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:15 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:16.356378 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-38825e99-4e95-46cc-baac-3cbe7079e3d2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:16.356987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-38825e99-4e95-46cc-baac-3cbe7079e3d2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:16.363295 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38825e99-4e95-46cc-baac-3cbe7079e3d2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:16.363764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38825e99-4e95-46cc-baac-3cbe7079e3d2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:16.364190 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38825e99-4e95-46cc-baac-3cbe7079e3d2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:16.364862 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38825e99-4e95-46cc-baac-3cbe7079e3d2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:16.365305 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38825e99-4e95-46cc-baac-3cbe7079e3d2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:16.365719 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38825e99-4e95-46cc-baac-3cbe7079e3d2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:16.491897 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-38825e99-4e95-46cc-baac-3cbe7079e3d2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:16.499680 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-38825e99-4e95-46cc-baac-3cbe7079e3d2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.147803 Aug 08 02:27:16.500243 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 158/331] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:16 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:16.510914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3c2940ed-6f9a-432f-90c8-00864a04f773 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:16.511519 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3c2940ed-6f9a-432f-90c8-00864a04f773 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:16.517394 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c2940ed-6f9a-432f-90c8-00864a04f773 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:16.517860 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c2940ed-6f9a-432f-90c8-00864a04f773 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:16.518308 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c2940ed-6f9a-432f-90c8-00864a04f773 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:16.518985 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c2940ed-6f9a-432f-90c8-00864a04f773 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:16.519427 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c2940ed-6f9a-432f-90c8-00864a04f773 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:16.519838 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c2940ed-6f9a-432f-90c8-00864a04f773 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:16.649550 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3c2940ed-6f9a-432f-90c8-00864a04f773 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:16.657338 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3c2940ed-6f9a-432f-90c8-00864a04f773 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.150756 Aug 08 02:27:16.657891 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 174/332] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:16 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:16.846745 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2158bbd3-7294-4081-a955-c3d095791603 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:16.847359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2158bbd3-7294-4081-a955-c3d095791603 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:16.853385 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2158bbd3-7294-4081-a955-c3d095791603 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:16.853872 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2158bbd3-7294-4081-a955-c3d095791603 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:16.854320 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2158bbd3-7294-4081-a955-c3d095791603 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:16.855017 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2158bbd3-7294-4081-a955-c3d095791603 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:16.855467 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2158bbd3-7294-4081-a955-c3d095791603 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:16.855972 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2158bbd3-7294-4081-a955-c3d095791603 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:16.985277 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2158bbd3-7294-4081-a955-c3d095791603 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:16.993580 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2158bbd3-7294-4081-a955-c3d095791603 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.150635 Aug 08 02:27:16.994844 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 159/333] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:16 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:17.520967 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-663e9cdd-7162-4839-a371-57695205559a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:17.521576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-663e9cdd-7162-4839-a371-57695205559a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:17.527722 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-663e9cdd-7162-4839-a371-57695205559a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:17.528199 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-663e9cdd-7162-4839-a371-57695205559a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:17.528633 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-663e9cdd-7162-4839-a371-57695205559a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:17.529316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-663e9cdd-7162-4839-a371-57695205559a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:17.529766 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-663e9cdd-7162-4839-a371-57695205559a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:17.530189 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-663e9cdd-7162-4839-a371-57695205559a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:17.658331 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-663e9cdd-7162-4839-a371-57695205559a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:17.665667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-663e9cdd-7162-4839-a371-57695205559a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.148537 Aug 08 02:27:17.666891 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 175/334] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:17 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:17.677709 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0a758c66-06e7-4560-b624-1052f015b639 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:17.678345 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0a758c66-06e7-4560-b624-1052f015b639 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:17.684648 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a758c66-06e7-4560-b624-1052f015b639 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:17.685121 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a758c66-06e7-4560-b624-1052f015b639 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:17.685553 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a758c66-06e7-4560-b624-1052f015b639 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:17.686231 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a758c66-06e7-4560-b624-1052f015b639 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:17.686710 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a758c66-06e7-4560-b624-1052f015b639 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:17.687127 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a758c66-06e7-4560-b624-1052f015b639 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:17.815959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0a758c66-06e7-4560-b624-1052f015b639 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:17.823247 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0a758c66-06e7-4560-b624-1052f015b639 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.149292 Aug 08 02:27:17.823806 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 160/335] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:17 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:18.014713 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-01bbe5ea-f397-4099-aac5-5c551770cad7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:18.015368 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-01bbe5ea-f397-4099-aac5-5c551770cad7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:18.021135 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01bbe5ea-f397-4099-aac5-5c551770cad7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:18.021614 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01bbe5ea-f397-4099-aac5-5c551770cad7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:18.022045 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01bbe5ea-f397-4099-aac5-5c551770cad7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:18.022752 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01bbe5ea-f397-4099-aac5-5c551770cad7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:18.023202 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01bbe5ea-f397-4099-aac5-5c551770cad7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:18.023620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01bbe5ea-f397-4099-aac5-5c551770cad7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:18.154443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-01bbe5ea-f397-4099-aac5-5c551770cad7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:18.162296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-01bbe5ea-f397-4099-aac5-5c551770cad7 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.151304 Aug 08 02:27:18.162852 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 176/336] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:18 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:18.687490 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-aeee9a95-5e56-44e2-8f86-26da544ed815 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:18.688102 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-aeee9a95-5e56-44e2-8f86-26da544ed815 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:18.694686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aeee9a95-5e56-44e2-8f86-26da544ed815 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:18.695172 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aeee9a95-5e56-44e2-8f86-26da544ed815 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:18.695602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aeee9a95-5e56-44e2-8f86-26da544ed815 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:18.696303 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aeee9a95-5e56-44e2-8f86-26da544ed815 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:18.696734 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aeee9a95-5e56-44e2-8f86-26da544ed815 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:18.697154 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aeee9a95-5e56-44e2-8f86-26da544ed815 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:18.843638 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b108fda7-5e6a-455d-91d6-305e96ec094d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:18.844242 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b108fda7-5e6a-455d-91d6-305e96ec094d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:18.850486 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b108fda7-5e6a-455d-91d6-305e96ec094d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:18.851148 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b108fda7-5e6a-455d-91d6-305e96ec094d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:18.851575 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b108fda7-5e6a-455d-91d6-305e96ec094d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:18.852260 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b108fda7-5e6a-455d-91d6-305e96ec094d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:18.852703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b108fda7-5e6a-455d-91d6-305e96ec094d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:18.853125 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b108fda7-5e6a-455d-91d6-305e96ec094d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:18.856103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-aeee9a95-5e56-44e2-8f86-26da544ed815 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:18.863576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-aeee9a95-5e56-44e2-8f86-26da544ed815 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.179895 Aug 08 02:27:18.864143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 161/337] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:18 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:18.984652 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b108fda7-5e6a-455d-91d6-305e96ec094d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:18.991943 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b108fda7-5e6a-455d-91d6-305e96ec094d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.152140 Aug 08 02:27:18.992526 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 177/338] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:18 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:19.183969 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8abd6ea2-edcc-47b9-9efb-2d8d00175e29 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:19.184577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8abd6ea2-edcc-47b9-9efb-2d8d00175e29 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:19.190972 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8abd6ea2-edcc-47b9-9efb-2d8d00175e29 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:19.191458 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8abd6ea2-edcc-47b9-9efb-2d8d00175e29 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:19.191896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8abd6ea2-edcc-47b9-9efb-2d8d00175e29 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:19.192585 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8abd6ea2-edcc-47b9-9efb-2d8d00175e29 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:19.193036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8abd6ea2-edcc-47b9-9efb-2d8d00175e29 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:19.193455 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8abd6ea2-edcc-47b9-9efb-2d8d00175e29 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:19.321234 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8abd6ea2-edcc-47b9-9efb-2d8d00175e29 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:19.329209 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8abd6ea2-edcc-47b9-9efb-2d8d00175e29 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.149093 Aug 08 02:27:19.329772 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 162/339] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:19 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:19.441365 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-10d0d1ae-40de-4ef7-8024-dac9804b1b75 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:19.441825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-10d0d1ae-40de-4ef7-8024-dac9804b1b75 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:19.448461 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10d0d1ae-40de-4ef7-8024-dac9804b1b75 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:19.448947 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10d0d1ae-40de-4ef7-8024-dac9804b1b75 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:19.449379 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10d0d1ae-40de-4ef7-8024-dac9804b1b75 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:19.450103 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10d0d1ae-40de-4ef7-8024-dac9804b1b75 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:19.450587 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10d0d1ae-40de-4ef7-8024-dac9804b1b75 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:19.451017 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10d0d1ae-40de-4ef7-8024-dac9804b1b75 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:19.475786 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-10d0d1ae-40de-4ef7-8024-dac9804b1b75 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:27:19.563247 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-10d0d1ae-40de-4ef7-8024-dac9804b1b75 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 204 len: 0 microversion: 2.1 time: 0.125827 Aug 08 02:27:19.563823 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 178/340] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:27:19 2022] DELETE /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:27:19.572792 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c65ace38-1496-4549-bde7-fbe9733c50e5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:19.573584 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c65ace38-1496-4549-bde7-fbe9733c50e5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:19.579474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c65ace38-1496-4549-bde7-fbe9733c50e5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:19.579962 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c65ace38-1496-4549-bde7-fbe9733c50e5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:19.580386 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c65ace38-1496-4549-bde7-fbe9733c50e5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:19.581071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c65ace38-1496-4549-bde7-fbe9733c50e5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:19.581524 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c65ace38-1496-4549-bde7-fbe9733c50e5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:19.581945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c65ace38-1496-4549-bde7-fbe9733c50e5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:19.707312 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c65ace38-1496-4549-bde7-fbe9733c50e5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:19.717200 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c65ace38-1496-4549-bde7-fbe9733c50e5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1504 microversion: 2.1 time: 0.148833 Aug 08 02:27:19.717775 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 163/341] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:19 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:19.886609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-34814a1e-a925-41f9-9500-71afe9f6f27a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:19.887337 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-34814a1e-a925-41f9-9500-71afe9f6f27a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:19.893942 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-34814a1e-a925-41f9-9500-71afe9f6f27a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:19.894458 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-34814a1e-a925-41f9-9500-71afe9f6f27a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:19.894890 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-34814a1e-a925-41f9-9500-71afe9f6f27a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:19.895572 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-34814a1e-a925-41f9-9500-71afe9f6f27a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:19.896019 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-34814a1e-a925-41f9-9500-71afe9f6f27a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:19.896443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-34814a1e-a925-41f9-9500-71afe9f6f27a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:20.021017 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-818d01a4-d016-40af-ab9a-314384a1b968 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:20.021708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-818d01a4-d016-40af-ab9a-314384a1b968 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:20.028198 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-818d01a4-d016-40af-ab9a-314384a1b968 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:20.028780 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-818d01a4-d016-40af-ab9a-314384a1b968 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:20.029430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-818d01a4-d016-40af-ab9a-314384a1b968 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:20.030568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-818d01a4-d016-40af-ab9a-314384a1b968 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:20.031227 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-818d01a4-d016-40af-ab9a-314384a1b968 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:20.031716 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-818d01a4-d016-40af-ab9a-314384a1b968 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:20.032412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-34814a1e-a925-41f9-9500-71afe9f6f27a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:20.040069 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-34814a1e-a925-41f9-9500-71afe9f6f27a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.158253 Aug 08 02:27:20.040643 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 179/342] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:19 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:20.164434 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-818d01a4-d016-40af-ab9a-314384a1b968 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:20.172530 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-818d01a4-d016-40af-ab9a-314384a1b968 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.163215 Aug 08 02:27:20.173143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 164/343] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:20 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:20.350354 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-09dc71d3-c763-49b9-8d46-b2abba1b0931 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:20.351118 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-09dc71d3-c763-49b9-8d46-b2abba1b0931 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:20.357418 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-09dc71d3-c763-49b9-8d46-b2abba1b0931 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:20.357897 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-09dc71d3-c763-49b9-8d46-b2abba1b0931 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:20.358359 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-09dc71d3-c763-49b9-8d46-b2abba1b0931 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:20.359051 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-09dc71d3-c763-49b9-8d46-b2abba1b0931 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:20.359497 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-09dc71d3-c763-49b9-8d46-b2abba1b0931 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:20.359914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-09dc71d3-c763-49b9-8d46-b2abba1b0931 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:20.491336 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-09dc71d3-c763-49b9-8d46-b2abba1b0931 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:20.499915 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-09dc71d3-c763-49b9-8d46-b2abba1b0931 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.153419 Aug 08 02:27:20.500482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 180/344] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:20 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:20.737825 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e4700524-6de2-4480-9018-e5554345fa7d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:20.738477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e4700524-6de2-4480-9018-e5554345fa7d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:20.744833 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4700524-6de2-4480-9018-e5554345fa7d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:20.745304 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4700524-6de2-4480-9018-e5554345fa7d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:20.745727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4700524-6de2-4480-9018-e5554345fa7d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:20.746431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4700524-6de2-4480-9018-e5554345fa7d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:20.746876 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4700524-6de2-4480-9018-e5554345fa7d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:20.747290 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4700524-6de2-4480-9018-e5554345fa7d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:20.875354 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e4700524-6de2-4480-9018-e5554345fa7d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:20.882796 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e4700524-6de2-4480-9018-e5554345fa7d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1504 microversion: 2.1 time: 0.148771 Aug 08 02:27:20.883361 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 165/345] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:20 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:21.061114 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-703d820b-ffca-4c3a-b399-05c2cf62779e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:21.061713 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-703d820b-ffca-4c3a-b399-05c2cf62779e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:21.067869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-703d820b-ffca-4c3a-b399-05c2cf62779e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:21.068340 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-703d820b-ffca-4c3a-b399-05c2cf62779e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:21.068764 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-703d820b-ffca-4c3a-b399-05c2cf62779e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:21.069431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-703d820b-ffca-4c3a-b399-05c2cf62779e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:21.069873 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-703d820b-ffca-4c3a-b399-05c2cf62779e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:21.070305 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-703d820b-ffca-4c3a-b399-05c2cf62779e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:21.201741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-608f80b6-2904-4e01-be88-a043c4d49c2f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:21.201741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-608f80b6-2904-4e01-be88-a043c4d49c2f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:21.201741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:21.201741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-608f80b6-2904-4e01-be88-a043c4d49c2f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:21.202236 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-608f80b6-2904-4e01-be88-a043c4d49c2f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:21.202770 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-608f80b6-2904-4e01-be88-a043c4d49c2f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:21.203481 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-608f80b6-2904-4e01-be88-a043c4d49c2f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:21.203937 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-608f80b6-2904-4e01-be88-a043c4d49c2f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:21.204363 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-608f80b6-2904-4e01-be88-a043c4d49c2f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:21.211722 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-703d820b-ffca-4c3a-b399-05c2cf62779e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:21.220110 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-703d820b-ffca-4c3a-b399-05c2cf62779e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.162732 Aug 08 02:27:21.221028 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 181/346] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:21 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:21.348328 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-608f80b6-2904-4e01-be88-a043c4d49c2f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:21.358026 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-608f80b6-2904-4e01-be88-a043c4d49c2f tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.168866 Aug 08 02:27:21.359068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 166/347] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:21 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:21.520414 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2c9fd91b-e9ba-4669-a906-cf16368700ef tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:21.521289 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2c9fd91b-e9ba-4669-a906-cf16368700ef tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:21.523477 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:21.529649 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c9fd91b-e9ba-4669-a906-cf16368700ef tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:21.530125 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c9fd91b-e9ba-4669-a906-cf16368700ef tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:21.531412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c9fd91b-e9ba-4669-a906-cf16368700ef tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:21.532112 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c9fd91b-e9ba-4669-a906-cf16368700ef tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:21.532564 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c9fd91b-e9ba-4669-a906-cf16368700ef tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:21.532983 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c9fd91b-e9ba-4669-a906-cf16368700ef tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:21.795077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2c9fd91b-e9ba-4669-a906-cf16368700ef tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:21.802861 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2c9fd91b-e9ba-4669-a906-cf16368700ef tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.286340 Aug 08 02:27:21.803424 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 182/348] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:21 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:21.903352 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5e89bcb8-d1e8-4840-90f5-e53587c8deb6 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:21.903974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5e89bcb8-d1e8-4840-90f5-e53587c8deb6 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:21.910404 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e89bcb8-d1e8-4840-90f5-e53587c8deb6 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:21.910886 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e89bcb8-d1e8-4840-90f5-e53587c8deb6 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:21.911318 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e89bcb8-d1e8-4840-90f5-e53587c8deb6 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:21.912006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e89bcb8-d1e8-4840-90f5-e53587c8deb6 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:21.912461 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e89bcb8-d1e8-4840-90f5-e53587c8deb6 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:21.912884 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e89bcb8-d1e8-4840-90f5-e53587c8deb6 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:22.039584 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5e89bcb8-d1e8-4840-90f5-e53587c8deb6 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:22.047474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5e89bcb8-d1e8-4840-90f5-e53587c8deb6 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1504 microversion: 2.1 time: 0.147986 Aug 08 02:27:22.048033 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 167/349] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:21 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:22.240937 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-57c4f38f-41e4-4645-81a2-0c952fdaa154 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:22.241534 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-57c4f38f-41e4-4645-81a2-0c952fdaa154 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:22.247369 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57c4f38f-41e4-4645-81a2-0c952fdaa154 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:22.247833 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57c4f38f-41e4-4645-81a2-0c952fdaa154 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:22.248248 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57c4f38f-41e4-4645-81a2-0c952fdaa154 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:22.248912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57c4f38f-41e4-4645-81a2-0c952fdaa154 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:22.249351 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57c4f38f-41e4-4645-81a2-0c952fdaa154 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:22.249761 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57c4f38f-41e4-4645-81a2-0c952fdaa154 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:22.378343 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-57c4f38f-41e4-4645-81a2-0c952fdaa154 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:22.379546 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9d216f71-9597-4179-a07b-d925de12dc8e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:22.380191 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9d216f71-9597-4179-a07b-d925de12dc8e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:22.386284 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-57c4f38f-41e4-4645-81a2-0c952fdaa154 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.149070 Aug 08 02:27:22.386851 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 183/350] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:22 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:22.387144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d216f71-9597-4179-a07b-d925de12dc8e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:22.387706 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d216f71-9597-4179-a07b-d925de12dc8e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:22.388213 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d216f71-9597-4179-a07b-d925de12dc8e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:22.388925 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d216f71-9597-4179-a07b-d925de12dc8e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:22.389376 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d216f71-9597-4179-a07b-d925de12dc8e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:22.389796 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d216f71-9597-4179-a07b-d925de12dc8e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:22.523247 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9d216f71-9597-4179-a07b-d925de12dc8e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:22.531402 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9d216f71-9597-4179-a07b-d925de12dc8e tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.155684 Aug 08 02:27:22.531973 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 168/351] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:22 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:22.824732 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-86076943-0676-4b0b-856a-b62e4029fb12 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:22.825334 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-86076943-0676-4b0b-856a-b62e4029fb12 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:22.831169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-86076943-0676-4b0b-856a-b62e4029fb12 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:22.831634 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-86076943-0676-4b0b-856a-b62e4029fb12 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:22.832071 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-86076943-0676-4b0b-856a-b62e4029fb12 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:22.832716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-86076943-0676-4b0b-856a-b62e4029fb12 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:22.833156 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-86076943-0676-4b0b-856a-b62e4029fb12 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:22.833566 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-86076943-0676-4b0b-856a-b62e4029fb12 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:22.962792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-86076943-0676-4b0b-856a-b62e4029fb12 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:22.970752 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-86076943-0676-4b0b-856a-b62e4029fb12 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.150441 Aug 08 02:27:22.971325 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 184/352] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:22 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:23.069334 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4ecfd901-f2e7-46fc-86bc-09a2db9b36c7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:23.069951 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4ecfd901-f2e7-46fc-86bc-09a2db9b36c7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:23.076944 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ecfd901-f2e7-46fc-86bc-09a2db9b36c7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:23.077377 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ecfd901-f2e7-46fc-86bc-09a2db9b36c7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:23.077818 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ecfd901-f2e7-46fc-86bc-09a2db9b36c7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:23.078531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ecfd901-f2e7-46fc-86bc-09a2db9b36c7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:23.078985 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ecfd901-f2e7-46fc-86bc-09a2db9b36c7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:23.079405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ecfd901-f2e7-46fc-86bc-09a2db9b36c7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:23.210483 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4ecfd901-f2e7-46fc-86bc-09a2db9b36c7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:23.217856 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4ecfd901-f2e7-46fc-86bc-09a2db9b36c7 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1504 microversion: 2.1 time: 0.152356 Aug 08 02:27:23.218444 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 169/353] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:23 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:23.406794 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9d238cba-eaec-4a4f-b49c-ee7f28dab71e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:23.407853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9d238cba-eaec-4a4f-b49c-ee7f28dab71e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:23.413735 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9d238cba-eaec-4a4f-b49c-ee7f28dab71e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:23.414203 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9d238cba-eaec-4a4f-b49c-ee7f28dab71e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:23.414663 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9d238cba-eaec-4a4f-b49c-ee7f28dab71e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:23.415341 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9d238cba-eaec-4a4f-b49c-ee7f28dab71e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:23.415780 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9d238cba-eaec-4a4f-b49c-ee7f28dab71e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:23.416716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9d238cba-eaec-4a4f-b49c-ee7f28dab71e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:23.436327 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:23.545482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-9d238cba-eaec-4a4f-b49c-ee7f28dab71e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:23.551602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6ac769dc-8778-4098-8613-1129e4ada3e1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:23.552298 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6ac769dc-8778-4098-8613-1129e4ada3e1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:23.554260 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9d238cba-eaec-4a4f-b49c-ee7f28dab71e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.151083 Aug 08 02:27:23.554842 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 185/354] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:23 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:23.559009 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ac769dc-8778-4098-8613-1129e4ada3e1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:23.559487 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ac769dc-8778-4098-8613-1129e4ada3e1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:23.559916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ac769dc-8778-4098-8613-1129e4ada3e1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:23.560595 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ac769dc-8778-4098-8613-1129e4ada3e1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:23.561036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ac769dc-8778-4098-8613-1129e4ada3e1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:23.561450 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ac769dc-8778-4098-8613-1129e4ada3e1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:23.686480 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6ac769dc-8778-4098-8613-1129e4ada3e1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:23.693910 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6ac769dc-8778-4098-8613-1129e4ada3e1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.146073 Aug 08 02:27:23.694505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 170/355] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:23 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:23.991208 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-139e5c58-5136-403b-b5d0-411d0f552214 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:23.991735 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-139e5c58-5136-403b-b5d0-411d0f552214 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:23.997612 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-139e5c58-5136-403b-b5d0-411d0f552214 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:23.998084 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-139e5c58-5136-403b-b5d0-411d0f552214 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:23.998554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-139e5c58-5136-403b-b5d0-411d0f552214 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:23.999225 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-139e5c58-5136-403b-b5d0-411d0f552214 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:23.999705 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-139e5c58-5136-403b-b5d0-411d0f552214 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:24.000123 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-139e5c58-5136-403b-b5d0-411d0f552214 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:24.124165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-139e5c58-5136-403b-b5d0-411d0f552214 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:24.132055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-139e5c58-5136-403b-b5d0-411d0f552214 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.144817 Aug 08 02:27:24.132610 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 186/356] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:23 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:24.238651 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3a762048-5e36-4fc1-bc4e-daad86f2e3c9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:24.239266 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3a762048-5e36-4fc1-bc4e-daad86f2e3c9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:24.245782 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a762048-5e36-4fc1-bc4e-daad86f2e3c9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:24.246206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a762048-5e36-4fc1-bc4e-daad86f2e3c9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:24.246665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a762048-5e36-4fc1-bc4e-daad86f2e3c9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:24.247349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a762048-5e36-4fc1-bc4e-daad86f2e3c9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:24.247798 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a762048-5e36-4fc1-bc4e-daad86f2e3c9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:24.248216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a762048-5e36-4fc1-bc4e-daad86f2e3c9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:24.377463 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a762048-5e36-4fc1-bc4e-daad86f2e3c9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:24.385699 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3a762048-5e36-4fc1-bc4e-daad86f2e3c9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1504 microversion: 2.1 time: 0.150872 Aug 08 02:27:24.386319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 171/357] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:24 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:24.576137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0abbc6fa-9e26-4850-8103-c7cb14b09e27 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:24.576744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0abbc6fa-9e26-4850-8103-c7cb14b09e27 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:24.582666 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0abbc6fa-9e26-4850-8103-c7cb14b09e27 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:24.583141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0abbc6fa-9e26-4850-8103-c7cb14b09e27 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:24.583606 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0abbc6fa-9e26-4850-8103-c7cb14b09e27 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:24.584284 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0abbc6fa-9e26-4850-8103-c7cb14b09e27 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:24.584736 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0abbc6fa-9e26-4850-8103-c7cb14b09e27 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:24.585152 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0abbc6fa-9e26-4850-8103-c7cb14b09e27 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:24.713639 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0abbc6fa-9e26-4850-8103-c7cb14b09e27 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:24.714617 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5eb4765d-55ad-43bd-902d-18a4f4bc7a3d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:24.715233 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5eb4765d-55ad-43bd-902d-18a4f4bc7a3d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:24.721023 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5eb4765d-55ad-43bd-902d-18a4f4bc7a3d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:24.721202 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0abbc6fa-9e26-4850-8103-c7cb14b09e27 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.149323 Aug 08 02:27:24.721496 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5eb4765d-55ad-43bd-902d-18a4f4bc7a3d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:24.722409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 187/358] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:24 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:24.722552 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5eb4765d-55ad-43bd-902d-18a4f4bc7a3d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:24.722658 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5eb4765d-55ad-43bd-902d-18a4f4bc7a3d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:24.723058 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5eb4765d-55ad-43bd-902d-18a4f4bc7a3d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:24.723475 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5eb4765d-55ad-43bd-902d-18a4f4bc7a3d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:24.850266 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5eb4765d-55ad-43bd-902d-18a4f4bc7a3d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:24.854234 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:24.859203 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5eb4765d-55ad-43bd-902d-18a4f4bc7a3d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.148721 Aug 08 02:27:24.859788 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 172/359] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:24 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:25.153348 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-61a180ca-8fca-47dc-a55f-0a45cf99799c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:25.153875 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-61a180ca-8fca-47dc-a55f-0a45cf99799c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:25.159845 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-61a180ca-8fca-47dc-a55f-0a45cf99799c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:25.160323 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-61a180ca-8fca-47dc-a55f-0a45cf99799c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:25.160754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-61a180ca-8fca-47dc-a55f-0a45cf99799c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:25.161436 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-61a180ca-8fca-47dc-a55f-0a45cf99799c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:25.161880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-61a180ca-8fca-47dc-a55f-0a45cf99799c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:25.162321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-61a180ca-8fca-47dc-a55f-0a45cf99799c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:25.291919 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-61a180ca-8fca-47dc-a55f-0a45cf99799c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:25.299983 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-61a180ca-8fca-47dc-a55f-0a45cf99799c tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.151070 Aug 08 02:27:25.300560 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 188/360] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:25 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:25.407158 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fae8069b-71a5-4aad-9404-919a29dfbb52 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:25.407725 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fae8069b-71a5-4aad-9404-919a29dfbb52 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:25.414003 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fae8069b-71a5-4aad-9404-919a29dfbb52 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:25.414516 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fae8069b-71a5-4aad-9404-919a29dfbb52 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:25.414947 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fae8069b-71a5-4aad-9404-919a29dfbb52 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:25.415621 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fae8069b-71a5-4aad-9404-919a29dfbb52 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:25.416633 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fae8069b-71a5-4aad-9404-919a29dfbb52 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:25.417052 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fae8069b-71a5-4aad-9404-919a29dfbb52 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:25.544392 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fae8069b-71a5-4aad-9404-919a29dfbb52 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:25.552007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fae8069b-71a5-4aad-9404-919a29dfbb52 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1504 microversion: 2.1 time: 0.148953 Aug 08 02:27:25.552585 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 173/361] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:25 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:25.742103 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-21c771ff-99f0-47ac-8829-d575596393f7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:25.742680 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-21c771ff-99f0-47ac-8829-d575596393f7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:25.748633 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-21c771ff-99f0-47ac-8829-d575596393f7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:25.749116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-21c771ff-99f0-47ac-8829-d575596393f7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:25.750184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-21c771ff-99f0-47ac-8829-d575596393f7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:25.750930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-21c771ff-99f0-47ac-8829-d575596393f7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:25.751385 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-21c771ff-99f0-47ac-8829-d575596393f7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:25.751822 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-21c771ff-99f0-47ac-8829-d575596393f7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:25.880106 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-720041b3-69c2-402a-b20c-a1a3692c7ae5 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:25.880714 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-720041b3-69c2-402a-b20c-a1a3692c7ae5 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:25.883830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-21c771ff-99f0-47ac-8829-d575596393f7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:25.887264 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-720041b3-69c2-402a-b20c-a1a3692c7ae5 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:25.887752 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-720041b3-69c2-402a-b20c-a1a3692c7ae5 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:25.888179 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-720041b3-69c2-402a-b20c-a1a3692c7ae5 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:25.888865 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-720041b3-69c2-402a-b20c-a1a3692c7ae5 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:25.889310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-720041b3-69c2-402a-b20c-a1a3692c7ae5 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:25.889729 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-720041b3-69c2-402a-b20c-a1a3692c7ae5 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:25.892259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-21c771ff-99f0-47ac-8829-d575596393f7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.154112 Aug 08 02:27:25.893086 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 189/362] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:25 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:26.019496 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-720041b3-69c2-402a-b20c-a1a3692c7ae5 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:26.026853 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-720041b3-69c2-402a-b20c-a1a3692c7ae5 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.150661 Aug 08 02:27:26.027424 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 174/363] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:25 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:26.320215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c638d602-8efe-4b91-ab8b-3fec1c2bf4bb tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:26.320745 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c638d602-8efe-4b91-ab8b-3fec1c2bf4bb tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:26.326555 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c638d602-8efe-4b91-ab8b-3fec1c2bf4bb tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:26.327041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c638d602-8efe-4b91-ab8b-3fec1c2bf4bb tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:26.327471 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c638d602-8efe-4b91-ab8b-3fec1c2bf4bb tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:26.328143 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c638d602-8efe-4b91-ab8b-3fec1c2bf4bb tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:26.328588 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c638d602-8efe-4b91-ab8b-3fec1c2bf4bb tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:26.329004 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c638d602-8efe-4b91-ab8b-3fec1c2bf4bb tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:26.455942 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c638d602-8efe-4b91-ab8b-3fec1c2bf4bb tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:26.463841 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c638d602-8efe-4b91-ab8b-3fec1c2bf4bb tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.147557 Aug 08 02:27:26.464377 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 190/364] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:26 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:26.572830 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-36f6b621-bdf8-4620-a1dc-cc3c3fadee40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:26.573376 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-36f6b621-bdf8-4620-a1dc-cc3c3fadee40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:26.579739 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-36f6b621-bdf8-4620-a1dc-cc3c3fadee40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:26.580220 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-36f6b621-bdf8-4620-a1dc-cc3c3fadee40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:26.580651 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-36f6b621-bdf8-4620-a1dc-cc3c3fadee40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:26.581336 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-36f6b621-bdf8-4620-a1dc-cc3c3fadee40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:26.581784 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-36f6b621-bdf8-4620-a1dc-cc3c3fadee40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:26.582236 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-36f6b621-bdf8-4620-a1dc-cc3c3fadee40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:26.710153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-36f6b621-bdf8-4620-a1dc-cc3c3fadee40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:26.718145 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-36f6b621-bdf8-4620-a1dc-cc3c3fadee40 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1504 microversion: 2.1 time: 0.149186 Aug 08 02:27:26.718742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 175/365] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:26 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:26.913219 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-16973f1a-89f2-447b-9124-26a728c0bf6f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:26.913732 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-16973f1a-89f2-447b-9124-26a728c0bf6f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:26.920321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-16973f1a-89f2-447b-9124-26a728c0bf6f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:26.920794 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-16973f1a-89f2-447b-9124-26a728c0bf6f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:26.921224 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-16973f1a-89f2-447b-9124-26a728c0bf6f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:26.921897 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-16973f1a-89f2-447b-9124-26a728c0bf6f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:26.922373 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-16973f1a-89f2-447b-9124-26a728c0bf6f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:26.922794 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-16973f1a-89f2-447b-9124-26a728c0bf6f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:27.046380 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-44d12232-eeb5-4101-b0b8-f89da3cd498b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:27.046997 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-44d12232-eeb5-4101-b0b8-f89da3cd498b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:27.053036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44d12232-eeb5-4101-b0b8-f89da3cd498b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:27.053522 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44d12232-eeb5-4101-b0b8-f89da3cd498b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:27.053961 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-16973f1a-89f2-447b-9124-26a728c0bf6f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:27.054091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44d12232-eeb5-4101-b0b8-f89da3cd498b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:27.054684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44d12232-eeb5-4101-b0b8-f89da3cd498b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:27.055136 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44d12232-eeb5-4101-b0b8-f89da3cd498b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:27.055557 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44d12232-eeb5-4101-b0b8-f89da3cd498b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:27.062580 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-16973f1a-89f2-447b-9124-26a728c0bf6f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.153003 Aug 08 02:27:27.063395 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 191/366] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:26 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:27.186737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-44d12232-eeb5-4101-b0b8-f89da3cd498b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:27.194499 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-44d12232-eeb5-4101-b0b8-f89da3cd498b tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.152041 Aug 08 02:27:27.195070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 176/367] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:27 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:27.484296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0ff96a8f-fbc5-402f-9990-df8c1457fe28 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:27.484904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0ff96a8f-fbc5-402f-9990-df8c1457fe28 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:27.490801 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ff96a8f-fbc5-402f-9990-df8c1457fe28 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:27.491272 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ff96a8f-fbc5-402f-9990-df8c1457fe28 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:27.491699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ff96a8f-fbc5-402f-9990-df8c1457fe28 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:27.492373 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ff96a8f-fbc5-402f-9990-df8c1457fe28 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:27.492818 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ff96a8f-fbc5-402f-9990-df8c1457fe28 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:27.493234 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ff96a8f-fbc5-402f-9990-df8c1457fe28 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:27.625919 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0ff96a8f-fbc5-402f-9990-df8c1457fe28 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:27.633840 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0ff96a8f-fbc5-402f-9990-df8c1457fe28 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.153428 Aug 08 02:27:27.634495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 192/368] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:27 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:27.739626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6b3e91ec-fb03-40a0-9ccd-36519d2c44bb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:27.740170 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6b3e91ec-fb03-40a0-9ccd-36519d2c44bb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:27.747211 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b3e91ec-fb03-40a0-9ccd-36519d2c44bb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:27.747688 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b3e91ec-fb03-40a0-9ccd-36519d2c44bb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:27.748150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b3e91ec-fb03-40a0-9ccd-36519d2c44bb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:27.748832 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b3e91ec-fb03-40a0-9ccd-36519d2c44bb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:27.749283 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b3e91ec-fb03-40a0-9ccd-36519d2c44bb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:27.749700 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b3e91ec-fb03-40a0-9ccd-36519d2c44bb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:27.875841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6b3e91ec-fb03-40a0-9ccd-36519d2c44bb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:27.883220 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6b3e91ec-fb03-40a0-9ccd-36519d2c44bb tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1504 microversion: 2.1 time: 0.147453 Aug 08 02:27:27.883782 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 177/369] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:27 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:28.085118 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b93120b5-27cb-4e34-b4ef-081ec6ccd39b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:28.085762 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b93120b5-27cb-4e34-b4ef-081ec6ccd39b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:28.092281 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b93120b5-27cb-4e34-b4ef-081ec6ccd39b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:28.092757 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b93120b5-27cb-4e34-b4ef-081ec6ccd39b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:28.093186 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b93120b5-27cb-4e34-b4ef-081ec6ccd39b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:28.093873 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b93120b5-27cb-4e34-b4ef-081ec6ccd39b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:28.094345 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b93120b5-27cb-4e34-b4ef-081ec6ccd39b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:28.094769 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b93120b5-27cb-4e34-b4ef-081ec6ccd39b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:28.216054 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5c65318b-0022-4cee-b10f-b0eec6997de2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:28.216672 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5c65318b-0022-4cee-b10f-b0eec6997de2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:28.222546 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c65318b-0022-4cee-b10f-b0eec6997de2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:28.223010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b93120b5-27cb-4e34-b4ef-081ec6ccd39b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:28.223129 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c65318b-0022-4cee-b10f-b0eec6997de2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:28.223443 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c65318b-0022-4cee-b10f-b0eec6997de2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:28.224127 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c65318b-0022-4cee-b10f-b0eec6997de2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:28.224574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c65318b-0022-4cee-b10f-b0eec6997de2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:28.224999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c65318b-0022-4cee-b10f-b0eec6997de2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:28.231436 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b93120b5-27cb-4e34-b4ef-081ec6ccd39b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.150138 Aug 08 02:27:28.231997 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 193/370] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:28 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:28.354831 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5c65318b-0022-4cee-b10f-b0eec6997de2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:28.362068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5c65318b-0022-4cee-b10f-b0eec6997de2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.150442 Aug 08 02:27:28.362667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 178/371] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:28 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:28.654686 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6e7481fa-8f56-448b-80af-ab3ee8b218c1 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:28.655294 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6e7481fa-8f56-448b-80af-ab3ee8b218c1 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:28.661038 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e7481fa-8f56-448b-80af-ab3ee8b218c1 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:28.661660 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e7481fa-8f56-448b-80af-ab3ee8b218c1 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:28.661933 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e7481fa-8f56-448b-80af-ab3ee8b218c1 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:28.662644 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e7481fa-8f56-448b-80af-ab3ee8b218c1 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:28.663089 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e7481fa-8f56-448b-80af-ab3ee8b218c1 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:28.663505 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e7481fa-8f56-448b-80af-ab3ee8b218c1 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:28.797227 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6e7481fa-8f56-448b-80af-ab3ee8b218c1 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:28.805326 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6e7481fa-8f56-448b-80af-ab3ee8b218c1 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.154958 Aug 08 02:27:28.805891 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 194/372] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:28 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:28.903864 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ab9f3b19-e072-4230-aeba-e4750405da64 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:28.904420 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ab9f3b19-e072-4230-aeba-e4750405da64 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:28.910834 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab9f3b19-e072-4230-aeba-e4750405da64 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:28.911308 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab9f3b19-e072-4230-aeba-e4750405da64 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:28.911725 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab9f3b19-e072-4230-aeba-e4750405da64 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:28.912402 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab9f3b19-e072-4230-aeba-e4750405da64 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:28.912843 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab9f3b19-e072-4230-aeba-e4750405da64 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:28.913256 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ab9f3b19-e072-4230-aeba-e4750405da64 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:29.042542 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ab9f3b19-e072-4230-aeba-e4750405da64 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:29.049873 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ab9f3b19-e072-4230-aeba-e4750405da64 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1504 microversion: 2.1 time: 0.149909 Aug 08 02:27:29.050478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 179/373] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:28 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:29.252191 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-51f63f8e-c121-4cfb-99ff-f4f8d43c3b35 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:29.252827 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-51f63f8e-c121-4cfb-99ff-f4f8d43c3b35 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:29.258853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-51f63f8e-c121-4cfb-99ff-f4f8d43c3b35 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:29.259326 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-51f63f8e-c121-4cfb-99ff-f4f8d43c3b35 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:29.259753 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-51f63f8e-c121-4cfb-99ff-f4f8d43c3b35 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:29.260428 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-51f63f8e-c121-4cfb-99ff-f4f8d43c3b35 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:29.260876 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-51f63f8e-c121-4cfb-99ff-f4f8d43c3b35 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:29.261291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-51f63f8e-c121-4cfb-99ff-f4f8d43c3b35 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:29.382584 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-60453e24-ee2a-489d-b150-ceee7cedfded tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:29.383199 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-60453e24-ee2a-489d-b150-ceee7cedfded tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:29.386742 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-51f63f8e-c121-4cfb-99ff-f4f8d43c3b35 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:29.389156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60453e24-ee2a-489d-b150-ceee7cedfded tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:29.389630 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60453e24-ee2a-489d-b150-ceee7cedfded tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:29.390056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60453e24-ee2a-489d-b150-ceee7cedfded tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:29.390767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60453e24-ee2a-489d-b150-ceee7cedfded tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:29.391215 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60453e24-ee2a-489d-b150-ceee7cedfded tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:29.391632 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60453e24-ee2a-489d-b150-ceee7cedfded tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:29.394335 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-51f63f8e-c121-4cfb-99ff-f4f8d43c3b35 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.145952 Aug 08 02:27:29.395091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 195/374] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:29 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:29.559713 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-60453e24-ee2a-489d-b150-ceee7cedfded tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:29.567815 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-60453e24-ee2a-489d-b150-ceee7cedfded tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1314 microversion: 2.1 time: 0.189047 Aug 08 02:27:29.568382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 180/375] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:29 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:29.826886 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0324b5f4-de0b-406d-8125-0755a9f04714 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:29.827500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0324b5f4-de0b-406d-8125-0755a9f04714 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:29.833584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0324b5f4-de0b-406d-8125-0755a9f04714 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:29.834062 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0324b5f4-de0b-406d-8125-0755a9f04714 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:29.834528 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0324b5f4-de0b-406d-8125-0755a9f04714 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:29.835216 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0324b5f4-de0b-406d-8125-0755a9f04714 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:29.835669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0324b5f4-de0b-406d-8125-0755a9f04714 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:29.836091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0324b5f4-de0b-406d-8125-0755a9f04714 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:29.981800 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0324b5f4-de0b-406d-8125-0755a9f04714 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:29.995133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0324b5f4-de0b-406d-8125-0755a9f04714 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1554 microversion: 2.1 time: 0.171977 Aug 08 02:27:29.995733 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 196/376] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:29 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:30.071128 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f93b03c1-cafe-4454-90e4-b932933fa5a4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:30.071735 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f93b03c1-cafe-4454-90e4-b932933fa5a4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:30.078524 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f93b03c1-cafe-4454-90e4-b932933fa5a4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:30.079000 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f93b03c1-cafe-4454-90e4-b932933fa5a4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:30.079434 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f93b03c1-cafe-4454-90e4-b932933fa5a4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:30.080110 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f93b03c1-cafe-4454-90e4-b932933fa5a4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:30.080553 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f93b03c1-cafe-4454-90e4-b932933fa5a4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:30.080965 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f93b03c1-cafe-4454-90e4-b932933fa5a4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:30.297990 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f93b03c1-cafe-4454-90e4-b932933fa5a4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:30.308428 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f93b03c1-cafe-4454-90e4-b932933fa5a4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1504 microversion: 2.1 time: 0.240201 Aug 08 02:27:30.309060 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 181/377] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:30 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1504 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:30.415816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6e366c46-2c56-4c69-a7c8-5a44e19494a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:30.416613 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6e366c46-2c56-4c69-a7c8-5a44e19494a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:30.423120 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e366c46-2c56-4c69-a7c8-5a44e19494a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:30.423878 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e366c46-2c56-4c69-a7c8-5a44e19494a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:30.424494 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e366c46-2c56-4c69-a7c8-5a44e19494a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:30.425928 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e366c46-2c56-4c69-a7c8-5a44e19494a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:30.426688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e366c46-2c56-4c69-a7c8-5a44e19494a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:30.427350 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e366c46-2c56-4c69-a7c8-5a44e19494a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:30.591799 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-97a15926-36ea-4327-9e76-3d00c1c515c9 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:30.592514 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-97a15926-36ea-4327-9e76-3d00c1c515c9 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:30.600724 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97a15926-36ea-4327-9e76-3d00c1c515c9 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:30.601211 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97a15926-36ea-4327-9e76-3d00c1c515c9 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:30.601691 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97a15926-36ea-4327-9e76-3d00c1c515c9 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:30.602420 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97a15926-36ea-4327-9e76-3d00c1c515c9 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:30.602868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97a15926-36ea-4327-9e76-3d00c1c515c9 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:30.603285 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97a15926-36ea-4327-9e76-3d00c1c515c9 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:30.676351 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6e366c46-2c56-4c69-a7c8-5a44e19494a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:30.688244 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6e366c46-2c56-4c69-a7c8-5a44e19494a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.276695 Aug 08 02:27:30.688941 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 197/378] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:30 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:30.694678 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-dd91550b-d865-4d96-b609-d7da8af7f61a req-1ba0f467-ed6d-48ee-b33d-15c06b65d622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f526af59-111b-48d0-a2aa-b861530026b9", "name": "network-vif-deleted", "tag": "da5825a9-2610-47e2-97f4-499c5f751915"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:27:30.706534 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-dd91550b-d865-4d96-b609-d7da8af7f61a req-1ba0f467-ed6d-48ee-b33d-15c06b65d622 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:30.707006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-dd91550b-d865-4d96-b609-d7da8af7f61a req-1ba0f467-ed6d-48ee-b33d-15c06b65d622 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:30.707592 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-dd91550b-d865-4d96-b609-d7da8af7f61a req-1ba0f467-ed6d-48ee-b33d-15c06b65d622 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:30.721160 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-dd91550b-d865-4d96-b609-d7da8af7f61a req-1ba0f467-ed6d-48ee-b33d-15c06b65d622 service nova] Creating event network-vif-deleted:da5825a9-2610-47e2-97f4-499c5f751915 for instance f526af59-111b-48d0-a2aa-b861530026b9 on hv-cinder-73306 Aug 08 02:27:30.726543 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-dd91550b-d865-4d96-b609-d7da8af7f61a req-1ba0f467-ed6d-48ee-b33d-15c06b65d622 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035888 Aug 08 02:27:30.727435 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 198/379] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:27:30.747363 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-97a15926-36ea-4327-9e76-3d00c1c515c9 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:30.755017 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-97a15926-36ea-4327-9e76-3d00c1c515c9 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1463 microversion: 2.1 time: 0.169537 Aug 08 02:27:30.755593 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 182/380] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:30 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1463 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:30.803668 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-882333b6-4cc3-4e43-bc3f-db6dab015307 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:30.804528 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-882333b6-4cc3-4e43-bc3f-db6dab015307 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:30.812411 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-882333b6-4cc3-4e43-bc3f-db6dab015307 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:30.813017 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-882333b6-4cc3-4e43-bc3f-db6dab015307 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:30.813511 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-882333b6-4cc3-4e43-bc3f-db6dab015307 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:30.814615 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-882333b6-4cc3-4e43-bc3f-db6dab015307 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:30.815183 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-882333b6-4cc3-4e43-bc3f-db6dab015307 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:30.815665 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-882333b6-4cc3-4e43-bc3f-db6dab015307 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:30.824392 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-5f998753-2aee-4640-a7b8-7b21fcbe464c req-2162e23c-2600-4b87-bd6e-e7f82018deef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b990f50-db09-4b89-af90-d4e0d75e0458", "name": "network-vif-deleted", "tag": "6f8cd2db-8f57-4877-bbef-d1a00190232b"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:27:30.833867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-5f998753-2aee-4640-a7b8-7b21fcbe464c req-2162e23c-2600-4b87-bd6e-e7f82018deef service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:30.834456 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-5f998753-2aee-4640-a7b8-7b21fcbe464c req-2162e23c-2600-4b87-bd6e-e7f82018deef service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:30.834899 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-5f998753-2aee-4640-a7b8-7b21fcbe464c req-2162e23c-2600-4b87-bd6e-e7f82018deef service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:30.846053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-5f998753-2aee-4640-a7b8-7b21fcbe464c req-2162e23c-2600-4b87-bd6e-e7f82018deef service nova] Creating event network-vif-deleted:6f8cd2db-8f57-4877-bbef-d1a00190232b for instance 1b990f50-db09-4b89-af90-d4e0d75e0458 on hv-cinder-73306 Aug 08 02:27:30.847042 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-882333b6-4cc3-4e43-bc3f-db6dab015307 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:27:30.851475 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-5f998753-2aee-4640-a7b8-7b21fcbe464c req-2162e23c-2600-4b87-bd6e-e7f82018deef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030604 Aug 08 02:27:30.852080 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 183/381] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:27:30.924725 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-882333b6-4cc3-4e43-bc3f-db6dab015307 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 204 len: 0 microversion: 2.1 time: 0.125140 Aug 08 02:27:30.925296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 199/382] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:27:30 2022] DELETE /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:27:30.934542 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6d71a670-2de8-482b-8c15-c8981a3422c1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:30.935244 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6d71a670-2de8-482b-8c15-c8981a3422c1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:30.941557 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d71a670-2de8-482b-8c15-c8981a3422c1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:30.942033 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d71a670-2de8-482b-8c15-c8981a3422c1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:30.942495 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d71a670-2de8-482b-8c15-c8981a3422c1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:30.943177 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d71a670-2de8-482b-8c15-c8981a3422c1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:30.943627 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d71a670-2de8-482b-8c15-c8981a3422c1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:30.944045 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d71a670-2de8-482b-8c15-c8981a3422c1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:31.017137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4d264bf4-2575-4590-aeea-4571d9f5e346 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:31.017907 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4d264bf4-2575-4590-aeea-4571d9f5e346 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:31.024078 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d264bf4-2575-4590-aeea-4571d9f5e346 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:31.024501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d264bf4-2575-4590-aeea-4571d9f5e346 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:31.024928 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d264bf4-2575-4590-aeea-4571d9f5e346 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:31.025644 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d264bf4-2575-4590-aeea-4571d9f5e346 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:31.026091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d264bf4-2575-4590-aeea-4571d9f5e346 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:31.027055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d264bf4-2575-4590-aeea-4571d9f5e346 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:31.074398 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6d71a670-2de8-482b-8c15-c8981a3422c1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:31.082468 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6d71a670-2de8-482b-8c15-c8981a3422c1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1469 microversion: 2.1 time: 0.152733 Aug 08 02:27:31.083040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 184/383] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:30 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:31.094127 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4d264bf4-2575-4590-aeea-4571d9f5e346 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:31.102076 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4d264bf4-2575-4590-aeea-4571d9f5e346 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1512 microversion: 2.1 time: 0.089724 Aug 08 02:27:31.102658 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 200/384] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:31 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1512 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:31.329612 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9db7de0a-127a-47cf-832e-5c034a9d9850 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:31.330148 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9db7de0a-127a-47cf-832e-5c034a9d9850 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:31.336015 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9db7de0a-127a-47cf-832e-5c034a9d9850 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:31.336494 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9db7de0a-127a-47cf-832e-5c034a9d9850 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:31.336920 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9db7de0a-127a-47cf-832e-5c034a9d9850 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:31.337587 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9db7de0a-127a-47cf-832e-5c034a9d9850 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:31.338031 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9db7de0a-127a-47cf-832e-5c034a9d9850 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:31.338509 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9db7de0a-127a-47cf-832e-5c034a9d9850 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:31.400909 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9db7de0a-127a-47cf-832e-5c034a9d9850 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:31.408743 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9db7de0a-127a-47cf-832e-5c034a9d9850 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1462 microversion: 2.1 time: 0.083085 Aug 08 02:27:31.409296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 185/385] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:31 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:31.709157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c41d0a4b-b467-425f-9946-e960051930c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:31.709697 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c41d0a4b-b467-425f-9946-e960051930c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:31.716342 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c41d0a4b-b467-425f-9946-e960051930c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:31.716821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c41d0a4b-b467-425f-9946-e960051930c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:31.717254 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c41d0a4b-b467-425f-9946-e960051930c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:31.717938 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c41d0a4b-b467-425f-9946-e960051930c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:31.718423 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c41d0a4b-b467-425f-9946-e960051930c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:31.718847 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c41d0a4b-b467-425f-9946-e960051930c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:31.722824 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:31.846376 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c41d0a4b-b467-425f-9946-e960051930c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:31.853734 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c41d0a4b-b467-425f-9946-e960051930c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.148572 Aug 08 02:27:31.854308 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 201/386] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:31 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:32.103515 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5e2342e9-fcee-49fe-ad77-8d749c80f243 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:32.104168 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5e2342e9-fcee-49fe-ad77-8d749c80f243 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:32.110604 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e2342e9-fcee-49fe-ad77-8d749c80f243 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:32.111080 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e2342e9-fcee-49fe-ad77-8d749c80f243 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:32.111511 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e2342e9-fcee-49fe-ad77-8d749c80f243 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:32.112195 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e2342e9-fcee-49fe-ad77-8d749c80f243 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:32.112643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e2342e9-fcee-49fe-ad77-8d749c80f243 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:32.113062 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e2342e9-fcee-49fe-ad77-8d749c80f243 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:32.123204 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e9b0588f-c87e-42a5-aeaa-5930e3a85baf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:32.123814 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e9b0588f-c87e-42a5-aeaa-5930e3a85baf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:32.129611 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e9b0588f-c87e-42a5-aeaa-5930e3a85baf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:32.130083 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e9b0588f-c87e-42a5-aeaa-5930e3a85baf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:32.130548 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e9b0588f-c87e-42a5-aeaa-5930e3a85baf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:32.131228 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e9b0588f-c87e-42a5-aeaa-5930e3a85baf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:32.131684 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e9b0588f-c87e-42a5-aeaa-5930e3a85baf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:32.132108 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e9b0588f-c87e-42a5-aeaa-5930e3a85baf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:32.195215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e9b0588f-c87e-42a5-aeaa-5930e3a85baf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:32.203274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e9b0588f-c87e-42a5-aeaa-5930e3a85baf tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1512 microversion: 2.1 time: 0.084244 Aug 08 02:27:32.203844 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 202/387] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:32 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1512 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:32.243489 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5e2342e9-fcee-49fe-ad77-8d749c80f243 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:32.251577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5e2342e9-fcee-49fe-ad77-8d749c80f243 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1469 microversion: 2.1 time: 0.151852 Aug 08 02:27:32.252150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 186/388] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:32 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:32.429919 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-47a8e0de-cd35-4530-b87b-27a481a28fba tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:32.430522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-47a8e0de-cd35-4530-b87b-27a481a28fba tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:32.437055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-47a8e0de-cd35-4530-b87b-27a481a28fba tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:32.437542 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-47a8e0de-cd35-4530-b87b-27a481a28fba tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:32.437973 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-47a8e0de-cd35-4530-b87b-27a481a28fba tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:32.438688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-47a8e0de-cd35-4530-b87b-27a481a28fba tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:32.439141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-47a8e0de-cd35-4530-b87b-27a481a28fba tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:32.439823 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-47a8e0de-cd35-4530-b87b-27a481a28fba tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:32.503572 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-47a8e0de-cd35-4530-b87b-27a481a28fba tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:32.511349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-47a8e0de-cd35-4530-b87b-27a481a28fba tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1462 microversion: 2.1 time: 0.085218 Aug 08 02:27:32.511937 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 203/389] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:32 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:32.874600 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-664f3b39-df45-4927-b40c-e7a88455d1e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:32.875212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-664f3b39-df45-4927-b40c-e7a88455d1e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:32.881291 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-664f3b39-df45-4927-b40c-e7a88455d1e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:32.881799 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-664f3b39-df45-4927-b40c-e7a88455d1e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:32.882234 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-664f3b39-df45-4927-b40c-e7a88455d1e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:32.882953 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-664f3b39-df45-4927-b40c-e7a88455d1e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:32.883411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-664f3b39-df45-4927-b40c-e7a88455d1e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:32.883820 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-664f3b39-df45-4927-b40c-e7a88455d1e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:33.011407 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-664f3b39-df45-4927-b40c-e7a88455d1e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:33.018870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-664f3b39-df45-4927-b40c-e7a88455d1e0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.148106 Aug 08 02:27:33.019435 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 187/390] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:32 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:33.227750 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e6aa6328-b741-4eae-9cd6-ead9111fc385 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:33.228352 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e6aa6328-b741-4eae-9cd6-ead9111fc385 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:33.234283 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e6aa6328-b741-4eae-9cd6-ead9111fc385 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:33.234758 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e6aa6328-b741-4eae-9cd6-ead9111fc385 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:33.235184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e6aa6328-b741-4eae-9cd6-ead9111fc385 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:33.235860 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e6aa6328-b741-4eae-9cd6-ead9111fc385 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:33.236304 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e6aa6328-b741-4eae-9cd6-ead9111fc385 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:33.236717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e6aa6328-b741-4eae-9cd6-ead9111fc385 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:33.272059 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0e745ecb-f657-437c-b270-063ff1a87499 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:33.272674 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0e745ecb-f657-437c-b270-063ff1a87499 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:33.279778 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e745ecb-f657-437c-b270-063ff1a87499 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:33.280259 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e745ecb-f657-437c-b270-063ff1a87499 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:33.280692 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e745ecb-f657-437c-b270-063ff1a87499 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:33.281397 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e745ecb-f657-437c-b270-063ff1a87499 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:33.281845 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e745ecb-f657-437c-b270-063ff1a87499 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:33.282280 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e745ecb-f657-437c-b270-063ff1a87499 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:33.297905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e6aa6328-b741-4eae-9cd6-ead9111fc385 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:33.305961 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e6aa6328-b741-4eae-9cd6-ead9111fc385 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1512 microversion: 2.1 time: 0.082006 Aug 08 02:27:33.306621 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 204/391] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:33 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1512 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:33.411573 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0e745ecb-f657-437c-b270-063ff1a87499 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:33.419091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0e745ecb-f657-437c-b270-063ff1a87499 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1469 microversion: 2.1 time: 0.150837 Aug 08 02:27:33.419662 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 188/392] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:33 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:33.532098 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-82bb6e74-ac3c-472e-9f4f-e0cde004b1c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:33.532740 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-82bb6e74-ac3c-472e-9f4f-e0cde004b1c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:33.538746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-82bb6e74-ac3c-472e-9f4f-e0cde004b1c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:33.539218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-82bb6e74-ac3c-472e-9f4f-e0cde004b1c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:33.539648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-82bb6e74-ac3c-472e-9f4f-e0cde004b1c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:33.540326 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-82bb6e74-ac3c-472e-9f4f-e0cde004b1c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:33.540775 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-82bb6e74-ac3c-472e-9f4f-e0cde004b1c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:33.541192 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-82bb6e74-ac3c-472e-9f4f-e0cde004b1c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:33.602210 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-82bb6e74-ac3c-472e-9f4f-e0cde004b1c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:33.609693 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-82bb6e74-ac3c-472e-9f4f-e0cde004b1c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1298 microversion: 2.1 time: 0.081469 Aug 08 02:27:33.610273 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 205/393] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:33 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:34.039349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5355d426-dfce-4dd2-9d6c-2eac6327312f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:34.039990 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5355d426-dfce-4dd2-9d6c-2eac6327312f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:34.046588 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5355d426-dfce-4dd2-9d6c-2eac6327312f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:34.047069 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5355d426-dfce-4dd2-9d6c-2eac6327312f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:34.047503 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5355d426-dfce-4dd2-9d6c-2eac6327312f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:34.048188 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5355d426-dfce-4dd2-9d6c-2eac6327312f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:34.048639 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5355d426-dfce-4dd2-9d6c-2eac6327312f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:34.049060 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5355d426-dfce-4dd2-9d6c-2eac6327312f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:34.175012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5355d426-dfce-4dd2-9d6c-2eac6327312f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:34.182426 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5355d426-dfce-4dd2-9d6c-2eac6327312f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.146906 Aug 08 02:27:34.182990 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 189/394] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:34 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:34.327515 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5625b234-35b8-48c0-a609-62bf4c8cc3f5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:34.328058 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5625b234-35b8-48c0-a609-62bf4c8cc3f5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:34.333943 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5625b234-35b8-48c0-a609-62bf4c8cc3f5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:34.334452 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5625b234-35b8-48c0-a609-62bf4c8cc3f5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:34.334887 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5625b234-35b8-48c0-a609-62bf4c8cc3f5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:34.335558 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5625b234-35b8-48c0-a609-62bf4c8cc3f5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:34.336017 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5625b234-35b8-48c0-a609-62bf4c8cc3f5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:34.336436 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5625b234-35b8-48c0-a609-62bf4c8cc3f5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:34.396189 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5625b234-35b8-48c0-a609-62bf4c8cc3f5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:34.404462 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5625b234-35b8-48c0-a609-62bf4c8cc3f5 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1512 microversion: 2.1 time: 0.080909 Aug 08 02:27:34.405016 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 206/395] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:34 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1512 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:34.440200 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f4f750d3-897a-471b-9986-ecbf3d505da0 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:34.440813 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f4f750d3-897a-471b-9986-ecbf3d505da0 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:34.447271 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4f750d3-897a-471b-9986-ecbf3d505da0 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:34.447752 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4f750d3-897a-471b-9986-ecbf3d505da0 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:34.448705 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4f750d3-897a-471b-9986-ecbf3d505da0 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:34.449396 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4f750d3-897a-471b-9986-ecbf3d505da0 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:34.449846 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4f750d3-897a-471b-9986-ecbf3d505da0 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:34.450292 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4f750d3-897a-471b-9986-ecbf3d505da0 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:34.454379 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:34.583977 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f4f750d3-897a-471b-9986-ecbf3d505da0 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:34.591944 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f4f750d3-897a-471b-9986-ecbf3d505da0 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1469 microversion: 2.1 time: 0.155910 Aug 08 02:27:34.592510 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 190/396] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:34 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:34.630467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7e522600-a874-45f1-91d0-11054f4e9c80 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:34.631068 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7e522600-a874-45f1-91d0-11054f4e9c80 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:34.637379 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7e522600-a874-45f1-91d0-11054f4e9c80 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:34.637843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7e522600-a874-45f1-91d0-11054f4e9c80 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:34.638285 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7e522600-a874-45f1-91d0-11054f4e9c80 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:34.638962 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7e522600-a874-45f1-91d0-11054f4e9c80 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:34.639404 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7e522600-a874-45f1-91d0-11054f4e9c80 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:34.639817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7e522600-a874-45f1-91d0-11054f4e9c80 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:34.702199 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7e522600-a874-45f1-91d0-11054f4e9c80 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:34.709476 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7e522600-a874-45f1-91d0-11054f4e9c80 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1298 microversion: 2.1 time: 0.082804 Aug 08 02:27:34.710032 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 207/397] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:34 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:35.203398 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-46bcf132-62c4-4479-a718-70fda392b49e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:35.204007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-46bcf132-62c4-4479-a718-70fda392b49e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:35.210081 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-46bcf132-62c4-4479-a718-70fda392b49e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:35.210587 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-46bcf132-62c4-4479-a718-70fda392b49e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:35.211018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-46bcf132-62c4-4479-a718-70fda392b49e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:35.211692 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-46bcf132-62c4-4479-a718-70fda392b49e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:35.212144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-46bcf132-62c4-4479-a718-70fda392b49e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:35.212557 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-46bcf132-62c4-4479-a718-70fda392b49e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:35.336918 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-46bcf132-62c4-4479-a718-70fda392b49e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:35.344210 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-46bcf132-62c4-4479-a718-70fda392b49e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.144671 Aug 08 02:27:35.344772 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 191/398] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:35 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:35.425114 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6d8cc607-0039-4ddd-a1aa-5a590aadd103 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:35.425723 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6d8cc607-0039-4ddd-a1aa-5a590aadd103 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:35.431839 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6d8cc607-0039-4ddd-a1aa-5a590aadd103 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:35.433141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6d8cc607-0039-4ddd-a1aa-5a590aadd103 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:35.433774 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6d8cc607-0039-4ddd-a1aa-5a590aadd103 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:35.434512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6d8cc607-0039-4ddd-a1aa-5a590aadd103 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:35.434961 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6d8cc607-0039-4ddd-a1aa-5a590aadd103 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:35.435964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6d8cc607-0039-4ddd-a1aa-5a590aadd103 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:35.502778 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6d8cc607-0039-4ddd-a1aa-5a590aadd103 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:35.510746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6d8cc607-0039-4ddd-a1aa-5a590aadd103 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1345 microversion: 2.1 time: 0.089461 Aug 08 02:27:35.511303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 208/399] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:35 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:35.611827 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cfc5ec03-994e-4bae-a68f-b694aad49f81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:35.612434 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cfc5ec03-994e-4bae-a68f-b694aad49f81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:35.618797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cfc5ec03-994e-4bae-a68f-b694aad49f81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:35.619278 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cfc5ec03-994e-4bae-a68f-b694aad49f81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:35.619708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cfc5ec03-994e-4bae-a68f-b694aad49f81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:35.620408 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cfc5ec03-994e-4bae-a68f-b694aad49f81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:35.620857 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cfc5ec03-994e-4bae-a68f-b694aad49f81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:35.621277 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cfc5ec03-994e-4bae-a68f-b694aad49f81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:35.731229 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7e44b61f-7bc6-4335-bc67-0da528f2c168 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:35.731833 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7e44b61f-7bc6-4335-bc67-0da528f2c168 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:35.737633 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7e44b61f-7bc6-4335-bc67-0da528f2c168 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:35.738087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7e44b61f-7bc6-4335-bc67-0da528f2c168 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:35.738551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7e44b61f-7bc6-4335-bc67-0da528f2c168 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:35.739231 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7e44b61f-7bc6-4335-bc67-0da528f2c168 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:35.739675 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7e44b61f-7bc6-4335-bc67-0da528f2c168 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:35.740113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7e44b61f-7bc6-4335-bc67-0da528f2c168 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:35.747980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cfc5ec03-994e-4bae-a68f-b694aad49f81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:35.755536 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cfc5ec03-994e-4bae-a68f-b694aad49f81 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1469 microversion: 2.1 time: 0.147553 Aug 08 02:27:35.756115 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 192/400] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:35 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1469 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:35.800318 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7e44b61f-7bc6-4335-bc67-0da528f2c168 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:35.807708 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7e44b61f-7bc6-4335-bc67-0da528f2c168 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1298 microversion: 2.1 time: 0.081098 Aug 08 02:27:35.808269 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 209/401] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:35 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1298 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:36.365006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dfc68cd5-041f-4395-b1d9-fdd03767a1bc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:36.365654 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dfc68cd5-041f-4395-b1d9-fdd03767a1bc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:36.372101 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfc68cd5-041f-4395-b1d9-fdd03767a1bc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:36.372582 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfc68cd5-041f-4395-b1d9-fdd03767a1bc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:36.373018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfc68cd5-041f-4395-b1d9-fdd03767a1bc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:36.373706 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfc68cd5-041f-4395-b1d9-fdd03767a1bc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:36.374160 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfc68cd5-041f-4395-b1d9-fdd03767a1bc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:36.374610 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfc68cd5-041f-4395-b1d9-fdd03767a1bc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:36.503893 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dfc68cd5-041f-4395-b1d9-fdd03767a1bc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:36.511970 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dfc68cd5-041f-4395-b1d9-fdd03767a1bc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.150805 Aug 08 02:27:36.512531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 193/402] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:36 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:36.530842 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-464e34da-f401-47b4-8264-ae6f62205e87 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:36.531469 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-464e34da-f401-47b4-8264-ae6f62205e87 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:36.537361 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-464e34da-f401-47b4-8264-ae6f62205e87 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:36.537845 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-464e34da-f401-47b4-8264-ae6f62205e87 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:36.538295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-464e34da-f401-47b4-8264-ae6f62205e87 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:36.538977 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-464e34da-f401-47b4-8264-ae6f62205e87 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:36.539425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-464e34da-f401-47b4-8264-ae6f62205e87 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:36.539845 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-464e34da-f401-47b4-8264-ae6f62205e87 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:36.599223 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-464e34da-f401-47b4-8264-ae6f62205e87 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:36.606980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-464e34da-f401-47b4-8264-ae6f62205e87 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1345 microversion: 2.1 time: 0.079911 Aug 08 02:27:36.607544 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 210/403] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:36 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:36.776885 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6a9cf9fc-ce3f-4143-8195-3fd5c6d2dc0d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:36.777607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6a9cf9fc-ce3f-4143-8195-3fd5c6d2dc0d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:36.784004 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a9cf9fc-ce3f-4143-8195-3fd5c6d2dc0d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:36.784485 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a9cf9fc-ce3f-4143-8195-3fd5c6d2dc0d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:36.784916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a9cf9fc-ce3f-4143-8195-3fd5c6d2dc0d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:36.785596 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a9cf9fc-ce3f-4143-8195-3fd5c6d2dc0d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:36.786045 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a9cf9fc-ce3f-4143-8195-3fd5c6d2dc0d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:36.786494 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a9cf9fc-ce3f-4143-8195-3fd5c6d2dc0d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:36.828240 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:36.828853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:36.835108 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:36.835738 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:36.836238 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:36.837049 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:36.837572 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:36.838055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:36.894057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:36.894706 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:36.895351 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:36.896005 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.objects.instance [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lazy-loading 'fault' on Instance uuid f526af59-111b-48d0-a2aa-b861530026b9 {{(pid=117640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:27:36.926349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6a9cf9fc-ce3f-4143-8195-3fd5c6d2dc0d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:36.934940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6a9cf9fc-ce3f-4143-8195-3fd5c6d2dc0d tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1469 microversion: 2.1 time: 0.161902 Aug 08 02:27:36.935508 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 194/404] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:36 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:36.943563 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:36.951113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-37cd9ee5-6044-4a30-a53b-2617c21745b8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1303 microversion: 2.1 time: 0.126732 Aug 08 02:27:36.951663 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 211/405] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:36 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:37.533561 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eb732199-e3ed-4ac2-84db-7844e1b95c3f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:37.534170 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eb732199-e3ed-4ac2-84db-7844e1b95c3f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:37.540076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb732199-e3ed-4ac2-84db-7844e1b95c3f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:37.540554 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb732199-e3ed-4ac2-84db-7844e1b95c3f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:37.540985 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb732199-e3ed-4ac2-84db-7844e1b95c3f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:37.541666 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb732199-e3ed-4ac2-84db-7844e1b95c3f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:37.542119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb732199-e3ed-4ac2-84db-7844e1b95c3f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:37.542564 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb732199-e3ed-4ac2-84db-7844e1b95c3f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:37.628141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7d711356-ce93-4fb6-95ca-e1581e58a279 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:37.628773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7d711356-ce93-4fb6-95ca-e1581e58a279 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:37.634680 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7d711356-ce93-4fb6-95ca-e1581e58a279 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:37.635153 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7d711356-ce93-4fb6-95ca-e1581e58a279 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:37.636064 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7d711356-ce93-4fb6-95ca-e1581e58a279 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:37.636746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7d711356-ce93-4fb6-95ca-e1581e58a279 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:37.637189 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7d711356-ce93-4fb6-95ca-e1581e58a279 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:37.637603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7d711356-ce93-4fb6-95ca-e1581e58a279 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:37.675774 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eb732199-e3ed-4ac2-84db-7844e1b95c3f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:37.683398 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eb732199-e3ed-4ac2-84db-7844e1b95c3f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.153747 Aug 08 02:27:37.683975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 195/406] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:37 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:37.700057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7d711356-ce93-4fb6-95ca-e1581e58a279 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:37.708077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7d711356-ce93-4fb6-95ca-e1581e58a279 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1345 microversion: 2.1 time: 0.083972 Aug 08 02:27:37.708629 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 212/407] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:37 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:37.956056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-52d61b24-2790-4e2b-bf5d-1a3de200d765 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:37.956592 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-52d61b24-2790-4e2b-bf5d-1a3de200d765 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:37.963220 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52d61b24-2790-4e2b-bf5d-1a3de200d765 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:37.963713 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52d61b24-2790-4e2b-bf5d-1a3de200d765 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:37.964153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52d61b24-2790-4e2b-bf5d-1a3de200d765 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:37.964887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52d61b24-2790-4e2b-bf5d-1a3de200d765 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:37.965341 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52d61b24-2790-4e2b-bf5d-1a3de200d765 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:37.965768 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52d61b24-2790-4e2b-bf5d-1a3de200d765 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:37.970843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:37.971451 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:37.977265 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:37.977740 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:37.978165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:37.978952 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:37.979398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:37.979816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:38.009838 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:38.010345 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:38.011459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:38.011897 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.objects.instance [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lazy-loading 'fault' on Instance uuid f526af59-111b-48d0-a2aa-b861530026b9 {{(pid=117640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:27:38.051195 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:38.059165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-594ff848-9355-49a7-b272-2504223fe12b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1303 microversion: 2.1 time: 0.092005 Aug 08 02:27:38.059731 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 213/408] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:37 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:38.094527 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-52d61b24-2790-4e2b-bf5d-1a3de200d765 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:38.101958 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-52d61b24-2790-4e2b-bf5d-1a3de200d765 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1469 microversion: 2.1 time: 0.149874 Aug 08 02:27:38.102550 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 196/409] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:37 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:38.703610 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e809be1b-9782-458e-a6c2-02ad1b89624a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:38.704244 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e809be1b-9782-458e-a6c2-02ad1b89624a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:38.710188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e809be1b-9782-458e-a6c2-02ad1b89624a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:38.710721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e809be1b-9782-458e-a6c2-02ad1b89624a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:38.711152 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e809be1b-9782-458e-a6c2-02ad1b89624a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:38.711832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e809be1b-9782-458e-a6c2-02ad1b89624a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:38.712277 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e809be1b-9782-458e-a6c2-02ad1b89624a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:38.712694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e809be1b-9782-458e-a6c2-02ad1b89624a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:38.727632 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:38.728859 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:38.735036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:38.735585 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:38.736086 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:38.736844 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:38.737440 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:38.737853 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:38.771336 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:38.771898 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:38.772420 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:38.772928 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lazy-loading 'fault' on Instance uuid 1b990f50-db09-4b89-af90-d4e0d75e0458 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:27:38.823312 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee31a15cc0a481a85a8d0e161217df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c6c5ce3cd45f48c581553d10fdc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:38.834145 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2dfbb14e-5df4-4a7e-8f32-6fdc3435faf0 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 200 len: 1350 microversion: 2.1 time: 0.110395 Aug 08 02:27:38.835130 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 197/410] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:38 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:38.849636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e809be1b-9782-458e-a6c2-02ad1b89624a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:38.857908 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e809be1b-9782-458e-a6c2-02ad1b89624a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.158161 Aug 08 02:27:38.858495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 214/411] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:38 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:39.080033 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:39.080645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:39.087004 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:39.087479 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:39.087903 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:39.088583 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:39.089698 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:39.090111 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:39.122313 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:39.122513 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1aa42f2c-0485-4e34-8650-c180048fb4e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:39.122790 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:39.123119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1aa42f2c-0485-4e34-8650-c180048fb4e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:39.123229 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:39.123638 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lazy-loading 'fault' on Instance uuid f526af59-111b-48d0-a2aa-b861530026b9 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:27:39.129196 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1aa42f2c-0485-4e34-8650-c180048fb4e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:39.129671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1aa42f2c-0485-4e34-8650-c180048fb4e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:39.130099 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1aa42f2c-0485-4e34-8650-c180048fb4e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:39.130809 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1aa42f2c-0485-4e34-8650-c180048fb4e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:39.131258 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1aa42f2c-0485-4e34-8650-c180048fb4e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:39.131676 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1aa42f2c-0485-4e34-8650-c180048fb4e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:39.170426 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:39.210767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d1d7ce5d-27fe-4272-945d-5b220ee49295 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 200 len: 1303 microversion: 2.1 time: 0.125124 Aug 08 02:27:39.211750 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 198/412] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:39 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:39.334412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1aa42f2c-0485-4e34-8650-c180048fb4e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:39.341874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1aa42f2c-0485-4e34-8650-c180048fb4e2 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1469 microversion: 2.1 time: 0.223161 Aug 08 02:27:39.342460 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 215/413] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:39 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1469 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:39.855794 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0bbb1e79-528c-4dbc-8010-888fbfb96a66 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:39.856407 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0bbb1e79-528c-4dbc-8010-888fbfb96a66 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:39.863070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bbb1e79-528c-4dbc-8010-888fbfb96a66 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:39.863874 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bbb1e79-528c-4dbc-8010-888fbfb96a66 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:39.864305 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bbb1e79-528c-4dbc-8010-888fbfb96a66 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:39.864998 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bbb1e79-528c-4dbc-8010-888fbfb96a66 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:39.865445 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bbb1e79-528c-4dbc-8010-888fbfb96a66 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:39.867547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0bbb1e79-528c-4dbc-8010-888fbfb96a66 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:39.878333 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0ec5569e-82c4-47d9-9e55-873a52783b3b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:39.879664 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0ec5569e-82c4-47d9-9e55-873a52783b3b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:39.886832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ec5569e-82c4-47d9-9e55-873a52783b3b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:39.887471 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ec5569e-82c4-47d9-9e55-873a52783b3b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:39.888193 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ec5569e-82c4-47d9-9e55-873a52783b3b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:39.889038 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ec5569e-82c4-47d9-9e55-873a52783b3b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:39.889743 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ec5569e-82c4-47d9-9e55-873a52783b3b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:39.890621 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0ec5569e-82c4-47d9-9e55-873a52783b3b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:39.900564 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-0bbb1e79-528c-4dbc-8010-888fbfb96a66 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] HTTP exception thrown: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0bbb1e79-528c-4dbc-8010-888fbfb96a66 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Request method failure captured: Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 HTTP/1.1 Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQq5dyBWpg5soqZjT2kqTprKoify-_H4agHeLl_FyJv-LBgaIyOgiB65ceowNX3GIU34_xeZP14b2bp5aqmTasWHx4K4kkTGfF62mTGNMAYT64suTNUF_ZPSKCGR1jIqWqK096LT5YJuueSyUQlYKV29Mnqa8UnWZNou5ay-dZCko4 Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: e84c6c5ce3cd45f48c581553d10fdc10 Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-DeleteServersTestJSON-596380487 Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:27:39.914071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:27:39.915963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e84c6c5ce3cd45f48c581553d10fdc10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e84c6c5ce3cd45f48c581553d10fdc10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e84c6c5ce3cd45f48c581553d10fdc10", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e84c6c5ce3cd45f48c581553d10fdc10"}]}] Aug 08 02:27:39.915963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-DeleteServersTestJSON-596380487 Aug 08 02:27:39.915963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: e84c6c5ce3cd45f48c581553d10fdc10 Aug 08 02:27:39.915963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-DeleteServersTestJSON-596380487 Aug 08 02:27:39.915963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-DeleteServersTestJSON-596380487-project Aug 08 02:27:39.915963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:27:39.915963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:27:39.915963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 3ee31a15cc0a481a85a8d0e161217df4 Aug 08 02:27:39.915963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-DeleteServersTestJSON-596380487-project Aug 08 02:27:39.915963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:27:39.915963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:39.915963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '1b990f50-db09-4b89-af90-d4e0d75e0458'} Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:27:39.917217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:39.920107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:39.923068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0bbb1e79-528c-4dbc-8010-888fbfb96a66 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Returning 404 to user: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:27:39.923068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0bbb1e79-528c-4dbc-8010-888fbfb96a66 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 404 len: 111 microversion: 2.1 time: 0.065378 Aug 08 02:27:39.923068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 199/414] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:39 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:27:40.057476 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e84c8681-82da-4083-872c-c79eb7e9d673 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:40.059971 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e84c8681-82da-4083-872c-c79eb7e9d673 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:40.066804 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e84c8681-82da-4083-872c-c79eb7e9d673 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:40.067282 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e84c8681-82da-4083-872c-c79eb7e9d673 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:40.067774 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e84c8681-82da-4083-872c-c79eb7e9d673 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:40.068473 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e84c8681-82da-4083-872c-c79eb7e9d673 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:40.068920 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e84c8681-82da-4083-872c-c79eb7e9d673 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:40.069337 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e84c8681-82da-4083-872c-c79eb7e9d673 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:40.082837 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-e84c8681-82da-4083-872c-c79eb7e9d673 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] HTTP exception thrown: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e84c8681-82da-4083-872c-c79eb7e9d673 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Request method failure captured: Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458/os-volume_attachments HTTP/1.1 Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQq5dyBWpg5soqZjT2kqTprKoify-_H4agHeLl_FyJv-LBgaIyOgiB65ceowNX3GIU34_xeZP14b2bp5aqmTasWHx4K4kkTGfF62mTGNMAYT64suTNUF_ZPSKCGR1jIqWqK096LT5YJuueSyUQlYKV29Mnqa8UnWZNou5ay-dZCko4 Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: e84c6c5ce3cd45f48c581553d10fdc10 Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-DeleteServersTestJSON-596380487 Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:27:40.085319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:27:40.086675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e84c6c5ce3cd45f48c581553d10fdc10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e84c6c5ce3cd45f48c581553d10fdc10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e84c6c5ce3cd45f48c581553d10fdc10", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e84c6c5ce3cd45f48c581553d10fdc10"}]}] Aug 08 02:27:40.086675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-DeleteServersTestJSON-596380487 Aug 08 02:27:40.086675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: e84c6c5ce3cd45f48c581553d10fdc10 Aug 08 02:27:40.086675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-DeleteServersTestJSON-596380487 Aug 08 02:27:40.086675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-DeleteServersTestJSON-596380487-project Aug 08 02:27:40.086675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:27:40.086675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:27:40.086675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 3ee31a15cc0a481a85a8d0e161217df4 Aug 08 02:27:40.086675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-DeleteServersTestJSON-596380487-project Aug 08 02:27:40.086675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:27:40.086675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:40.086675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'server_id': '1b990f50-db09-4b89-af90-d4e0d75e0458'} Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:27:40.087477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:40.089319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:40.091594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e84c8681-82da-4083-872c-c79eb7e9d673 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Returning 404 to user: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:27:40.091594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e84c8681-82da-4083-872c-c79eb7e9d673 tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033400 Aug 08 02:27:40.091594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 200/415] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:27:40 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:27:40.165537 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0ec5569e-82c4-47d9-9e55-873a52783b3b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:40.174491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0ec5569e-82c4-47d9-9e55-873a52783b3b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.299835 Aug 08 02:27:40.175222 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 216/416] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:39 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:40.235893 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ad53b6e1-4558-484a-bbd8-20fda26699c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:40.237010 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ad53b6e1-4558-484a-bbd8-20fda26699c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: f526af59-111b-48d0-a2aa-b861530026b9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:40.248878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad53b6e1-4558-484a-bbd8-20fda26699c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:40.249717 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad53b6e1-4558-484a-bbd8-20fda26699c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:40.250540 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad53b6e1-4558-484a-bbd8-20fda26699c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:40.251784 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad53b6e1-4558-484a-bbd8-20fda26699c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:40.254576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad53b6e1-4558-484a-bbd8-20fda26699c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:40.254576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad53b6e1-4558-484a-bbd8-20fda26699c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-ad53b6e1-4558-484a-bbd8-20fda26699c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] HTTP exception thrown: Instance f526af59-111b-48d0-a2aa-b861530026b9 could not be found. Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ad53b6e1-4558-484a-bbd8-20fda26699c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Request method failure captured: Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 HTTP/1.1 Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HRMi9U8RELfedsGqQhDhz667nMlOxQ2jS0iEWmwzgMkBoSrKOknAr_V9ez1Mf12a72d2dOhqpr46xiEVhJIJpTLax74iSZTnhyFbZSmAqY_hltbx5eWpiTM--68KNfXn8Z4MSI4MzfjAuHo2hhAQiefcKwuh0TGA-p0lZM14nCJpug Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: d3cc8b8bc4964df4a494173af8540c45 Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesActionsTest-1493641150 Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:27:40.289814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:27:40.291186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d3cc8b8bc4964df4a494173af8540c45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d3cc8b8bc4964df4a494173af8540c45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d3cc8b8bc4964df4a494173af8540c45", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d3cc8b8bc4964df4a494173af8540c45"}]}] Aug 08 02:27:40.291186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesActionsTest-1493641150 Aug 08 02:27:40.291186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: d3cc8b8bc4964df4a494173af8540c45 Aug 08 02:27:40.291186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesActionsTest-1493641150 Aug 08 02:27:40.291186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesActionsTest-1493641150-project Aug 08 02:27:40.291186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:27:40.291186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:27:40.291186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 6916c2afef12490f921d99c5047b4dce Aug 08 02:27:40.291186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesActionsTest-1493641150-project Aug 08 02:27:40.291186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:27:40.291186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance f526af59-111b-48d0-a2aa-b861530026b9 could not be found. Aug 08 02:27:40.291186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': 'f526af59-111b-48d0-a2aa-b861530026b9'} Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f526af59-111b-48d0-a2aa-b861530026b9 could not be found. Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:27:40.292645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f526af59-111b-48d0-a2aa-b861530026b9 could not be found. Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f526af59-111b-48d0-a2aa-b861530026b9 could not be found. Aug 08 02:27:40.293870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:40.294919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ad53b6e1-4558-484a-bbd8-20fda26699c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Returning 404 to user: Instance f526af59-111b-48d0-a2aa-b861530026b9 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:27:40.294919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ad53b6e1-4558-484a-bbd8-20fda26699c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9" status: 404 len: 111 microversion: 2.1 time: 0.055490 Aug 08 02:27:40.294919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 201/417] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:40 2022] GET /compute/v2.1/servers/f526af59-111b-48d0-a2aa-b861530026b9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:27:40.362561 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4706f4ed-f66f-40b3-9a3d-772307d52e66 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:40.363406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4706f4ed-f66f-40b3-9a3d-772307d52e66 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:40.369663 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4706f4ed-f66f-40b3-9a3d-772307d52e66 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:40.370133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4706f4ed-f66f-40b3-9a3d-772307d52e66 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:40.370603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4706f4ed-f66f-40b3-9a3d-772307d52e66 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:40.371464 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4706f4ed-f66f-40b3-9a3d-772307d52e66 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:40.372041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4706f4ed-f66f-40b3-9a3d-772307d52e66 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:40.372465 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4706f4ed-f66f-40b3-9a3d-772307d52e66 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:40.392290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:40.430673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1505756117", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "networks": [{"uuid": "e663bc2c-6808-4d79-a335-4f90bd6f6339"}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:27:40.473980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4706f4ed-f66f-40b3-9a3d-772307d52e66 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:40.481636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4706f4ed-f66f-40b3-9a3d-772307d52e66 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1427 microversion: 2.1 time: 0.123260 Aug 08 02:27:40.482201 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 217/418] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:40 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:40.487685 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-e767684f-2a25-49d6-ab69-a12478f675c1 req-d214d9ab-efd2-47a9-84cc-f1362d70541c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65c2cae-5950-4951-87eb-74afaf315b13", "name": "network-vif-deleted", "tag": "e2682909-d123-436b-8815-168e8604fced"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:27:40.495769 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] validate_networks() for [('e663bc2c-6808-4d79-a335-4f90bd6f6339', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:27:40.502685 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-e767684f-2a25-49d6-ab69-a12478f675c1 req-d214d9ab-efd2-47a9-84cc-f1362d70541c service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:40.503339 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-e767684f-2a25-49d6-ab69-a12478f675c1 req-d214d9ab-efd2-47a9-84cc-f1362d70541c service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:40.503770 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-e767684f-2a25-49d6-ab69-a12478f675c1 req-d214d9ab-efd2-47a9-84cc-f1362d70541c service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:40.517283 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-e767684f-2a25-49d6-ab69-a12478f675c1 req-d214d9ab-efd2-47a9-84cc-f1362d70541c service nova] Creating event network-vif-deleted:e2682909-d123-436b-8815-168e8604fced for instance f65c2cae-5950-4951-87eb-74afaf315b13 on hv-cinder-73306 Aug 08 02:27:40.522800 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-e767684f-2a25-49d6-ab69-a12478f675c1 req-d214d9ab-efd2-47a9-84cc-f1362d70541c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038372 Aug 08 02:27:40.523405 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 218/419] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:27:40.860342 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:27:40.860759 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:27:40.861527 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:27:40.862308 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:27:40.862866 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:27:40.872107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:40.872630 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:40.873001 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:40.873711 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:40.874162 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:40.874616 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:40.891505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Getting quotas for project d3cc8b8bc4964df4a494173af8540c45. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:27:40.895394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Getting quotas for user 6916c2afef12490f921d99c5047b4dce and project d3cc8b8bc4964df4a494173af8540c45. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:27:40.906035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:27:40.908288 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:27:40.952584 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4993f78c-5507-4ee5-b814-102d67dab0ef tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525755 Aug 08 02:27:40.953208 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 202/420] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:27:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:27:40.964359 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6ccdb882-800a-447d-a467-9b9d4c2a1582 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:40.965046 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6ccdb882-800a-447d-a467-9b9d4c2a1582 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:41.025006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6ccdb882-800a-447d-a467-9b9d4c2a1582 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:41.033673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6ccdb882-800a-447d-a467-9b9d4c2a1582 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1214 microversion: 2.1 time: 0.073345 Aug 08 02:27:41.034549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 219/421] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:40 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:41.195425 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6e4a44d6-420a-406d-950a-7cc2b3c2be69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:41.196060 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6e4a44d6-420a-406d-950a-7cc2b3c2be69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:41.202176 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e4a44d6-420a-406d-950a-7cc2b3c2be69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:41.203061 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e4a44d6-420a-406d-950a-7cc2b3c2be69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:41.203677 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e4a44d6-420a-406d-950a-7cc2b3c2be69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:41.204569 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e4a44d6-420a-406d-950a-7cc2b3c2be69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:41.205028 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e4a44d6-420a-406d-950a-7cc2b3c2be69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:41.205451 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e4a44d6-420a-406d-950a-7cc2b3c2be69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:41.325555 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2c77a9d4-9080-402a-af90-0cc923ef24df tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:41.326817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2c77a9d4-9080-402a-af90-0cc923ef24df tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:41.335011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c77a9d4-9080-402a-af90-0cc923ef24df tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:41.335376 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c77a9d4-9080-402a-af90-0cc923ef24df tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:41.336004 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c77a9d4-9080-402a-af90-0cc923ef24df tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:41.336716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c77a9d4-9080-402a-af90-0cc923ef24df tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:41.337173 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c77a9d4-9080-402a-af90-0cc923ef24df tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:41.337597 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c77a9d4-9080-402a-af90-0cc923ef24df tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:41.356066 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-2c77a9d4-9080-402a-af90-0cc923ef24df tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] HTTP exception thrown: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2c77a9d4-9080-402a-af90-0cc923ef24df tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Request method failure captured: Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: DELETE /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 HTTP/1.1 Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQq5dyBWpg5soqZjT2kqTprKoify-_H4agHeLl_FyJv-LBgaIyOgiB65ceowNX3GIU34_xeZP14b2bp5aqmTasWHx4K4kkTGfF62mTGNMAYT64suTNUF_ZPSKCGR1jIqWqK096LT5YJuueSyUQlYKV29Mnqa8UnWZNou5ay-dZCko4 Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: e84c6c5ce3cd45f48c581553d10fdc10 Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-DeleteServersTestJSON-596380487 Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:27:41.362211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:27:41.363707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e84c6c5ce3cd45f48c581553d10fdc10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e84c6c5ce3cd45f48c581553d10fdc10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e84c6c5ce3cd45f48c581553d10fdc10", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e84c6c5ce3cd45f48c581553d10fdc10"}]}] Aug 08 02:27:41.363707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-DeleteServersTestJSON-596380487 Aug 08 02:27:41.363707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: e84c6c5ce3cd45f48c581553d10fdc10 Aug 08 02:27:41.363707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-DeleteServersTestJSON-596380487 Aug 08 02:27:41.363707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-DeleteServersTestJSON-596380487-project Aug 08 02:27:41.363707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:27:41.363707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:27:41.363707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 3ee31a15cc0a481a85a8d0e161217df4 Aug 08 02:27:41.363707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-DeleteServersTestJSON-596380487-project Aug 08 02:27:41.363707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:27:41.363707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:41.363707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '1b990f50-db09-4b89-af90-d4e0d75e0458'} Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:27:41.364508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:41.365673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:27:41.367903 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2c77a9d4-9080-402a-af90-0cc923ef24df tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Returning 404 to user: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:27:41.369091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2c77a9d4-9080-402a-af90-0cc923ef24df tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 404 len: 111 microversion: 2.1 time: 0.049282 Aug 08 02:27:41.370688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 220/422] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:27:41 2022] DELETE /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:27:41.371586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6e4a44d6-420a-406d-950a-7cc2b3c2be69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:41.378085 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-72451b87-3cf7-4cf1-b3f3-97b2d27cc4aa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:41.378784 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-72451b87-3cf7-4cf1-b3f3-97b2d27cc4aa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] [instance: 1b990f50-db09-4b89-af90-d4e0d75e0458] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:41.384837 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72451b87-3cf7-4cf1-b3f3-97b2d27cc4aa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:41.385362 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72451b87-3cf7-4cf1-b3f3-97b2d27cc4aa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:41.385698 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6e4a44d6-420a-406d-950a-7cc2b3c2be69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1523 microversion: 2.1 time: 0.191881 Aug 08 02:27:41.385867 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72451b87-3cf7-4cf1-b3f3-97b2d27cc4aa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:41.386770 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72451b87-3cf7-4cf1-b3f3-97b2d27cc4aa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:41.387144 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72451b87-3cf7-4cf1-b3f3-97b2d27cc4aa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:41.387733 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72451b87-3cf7-4cf1-b3f3-97b2d27cc4aa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:41.391591 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 203/423] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:41 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:41.404164 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-72451b87-3cf7-4cf1-b3f3-97b2d27cc4aa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] HTTP exception thrown: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-72451b87-3cf7-4cf1-b3f3-97b2d27cc4aa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Request method failure captured: Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 HTTP/1.1 Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQq5dyBWpg5soqZjT2kqTprKoify-_H4agHeLl_FyJv-LBgaIyOgiB65ceowNX3GIU34_xeZP14b2bp5aqmTasWHx4K4kkTGfF62mTGNMAYT64suTNUF_ZPSKCGR1jIqWqK096LT5YJuueSyUQlYKV29Mnqa8UnWZNou5ay-dZCko4 Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: e84c6c5ce3cd45f48c581553d10fdc10 Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-DeleteServersTestJSON-596380487 Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:27:41.405699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:27:41.407184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e84c6c5ce3cd45f48c581553d10fdc10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e84c6c5ce3cd45f48c581553d10fdc10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e84c6c5ce3cd45f48c581553d10fdc10", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e84c6c5ce3cd45f48c581553d10fdc10"}]}] Aug 08 02:27:41.407184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-DeleteServersTestJSON-596380487 Aug 08 02:27:41.407184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: e84c6c5ce3cd45f48c581553d10fdc10 Aug 08 02:27:41.407184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-DeleteServersTestJSON-596380487 Aug 08 02:27:41.407184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-DeleteServersTestJSON-596380487-project Aug 08 02:27:41.407184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:27:41.407184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:27:41.407184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 3ee31a15cc0a481a85a8d0e161217df4 Aug 08 02:27:41.407184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-DeleteServersTestJSON-596380487-project Aug 08 02:27:41.407184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:27:41.407184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:41.407184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '1b990f50-db09-4b89-af90-d4e0d75e0458'} Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:27:41.410836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. Aug 08 02:27:41.411930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:27:41.412988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-72451b87-3cf7-4cf1-b3f3-97b2d27cc4aa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] Returning 404 to user: Instance 1b990f50-db09-4b89-af90-d4e0d75e0458 could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:27:41.412988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-72451b87-3cf7-4cf1-b3f3-97b2d27cc4aa tempest-DeleteServersTestJSON-596380487 tempest-DeleteServersTestJSON-596380487-project] 10.222.0.39 "GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458" status: 404 len: 111 microversion: 2.1 time: 0.032801 Aug 08 02:27:41.412988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 221/424] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:41 2022] GET /compute/v2.1/servers/1b990f50-db09-4b89-af90-d4e0d75e0458 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:27:41.503400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:41.504308 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:41.510667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:41.511369 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:41.511957 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:41.512817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:41.513410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:41.513998 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:41.548284 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:41.548876 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:41.549585 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:41.550104 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lazy-loading 'fault' on Instance uuid f65c2cae-5950-4951-87eb-74afaf315b13 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:27:41.600216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:41.608927 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-199eaad2-b22c-4aa2-a6a0-a0673f83dd02 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1304 microversion: 2.1 time: 0.109535 Aug 08 02:27:41.610331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 204/425] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:41 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:42.054150 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1e077550-7588-4224-a1c7-abe891e1717d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:42.055534 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1e077550-7588-4224-a1c7-abe891e1717d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:42.063212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e077550-7588-4224-a1c7-abe891e1717d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:42.063696 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e077550-7588-4224-a1c7-abe891e1717d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:42.064931 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e077550-7588-4224-a1c7-abe891e1717d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:42.065445 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e077550-7588-4224-a1c7-abe891e1717d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:42.065903 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e077550-7588-4224-a1c7-abe891e1717d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:42.066362 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e077550-7588-4224-a1c7-abe891e1717d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:42.144440 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1e077550-7588-4224-a1c7-abe891e1717d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:42.153563 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1e077550-7588-4224-a1c7-abe891e1717d tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1218 microversion: 2.1 time: 0.103292 Aug 08 02:27:42.166455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 222/426] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:42 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:42.407705 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6aa9a39e-fffd-4609-879a-482353b13352 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:42.408356 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6aa9a39e-fffd-4609-879a-482353b13352 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:42.416359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6aa9a39e-fffd-4609-879a-482353b13352 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:42.416890 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6aa9a39e-fffd-4609-879a-482353b13352 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:42.417680 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6aa9a39e-fffd-4609-879a-482353b13352 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:42.418579 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6aa9a39e-fffd-4609-879a-482353b13352 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:42.419188 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6aa9a39e-fffd-4609-879a-482353b13352 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:42.419984 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6aa9a39e-fffd-4609-879a-482353b13352 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:42.631253 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:42.632298 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:42.640705 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:42.641524 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:42.642108 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:42.643031 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:42.643636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:42.644197 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:42.644313 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6aa9a39e-fffd-4609-879a-482353b13352 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:42.656409 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6aa9a39e-fffd-4609-879a-482353b13352 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1503 microversion: 2.1 time: 0.252601 Aug 08 02:27:42.675677 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 205/427] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:42 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:42.678710 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:42.679369 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:42.679960 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:42.680546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.objects.instance [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lazy-loading 'fault' on Instance uuid f65c2cae-5950-4951-87eb-74afaf315b13 {{(pid=117640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:27:42.688237 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-87450ccb-1d23-4e7f-88aa-a9d51c780243 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:42.692159 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-87450ccb-1d23-4e7f-88aa-a9d51c780243 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:42.697288 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:42.703143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87450ccb-1d23-4e7f-88aa-a9d51c780243 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:42.706554 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87450ccb-1d23-4e7f-88aa-a9d51c780243 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:42.707249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87450ccb-1d23-4e7f-88aa-a9d51c780243 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:42.710352 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87450ccb-1d23-4e7f-88aa-a9d51c780243 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:42.710981 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87450ccb-1d23-4e7f-88aa-a9d51c780243 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:42.712633 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87450ccb-1d23-4e7f-88aa-a9d51c780243 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:42.741780 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b69dd6e1f7c4d93af3a27f310a7704c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a56db115f64261ae4b472567a2265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:42.751492 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-de334f42-86ef-4d52-a9ae-53fd2c04e2f1 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 200 len: 1304 microversion: 2.1 time: 0.124268 Aug 08 02:27:42.752461 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 223/428] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:42 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:42.991769 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-87450ccb-1d23-4e7f-88aa-a9d51c780243 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:43.000897 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-87450ccb-1d23-4e7f-88aa-a9d51c780243 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1516 microversion: 2.1 time: 0.323906 Aug 08 02:27:43.017110 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 206/429] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:42 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1516 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:43.175649 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-542720f6-6a8c-4765-b977-3e329b104a53 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:43.176922 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-542720f6-6a8c-4765-b977-3e329b104a53 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:43.185095 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-542720f6-6a8c-4765-b977-3e329b104a53 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:43.185954 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-542720f6-6a8c-4765-b977-3e329b104a53 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:43.187047 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-542720f6-6a8c-4765-b977-3e329b104a53 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:43.188142 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-542720f6-6a8c-4765-b977-3e329b104a53 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:43.188764 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-542720f6-6a8c-4765-b977-3e329b104a53 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:43.189574 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-542720f6-6a8c-4765-b977-3e329b104a53 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:43.315410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-542720f6-6a8c-4765-b977-3e329b104a53 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:43.324827 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-542720f6-6a8c-4765-b977-3e329b104a53 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1210 microversion: 2.1 time: 0.153738 Aug 08 02:27:43.326192 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 224/430] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:43 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1210 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:43.775368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cf4d551f-2adf-4a94-84d8-dc0e75b60088 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:43.777368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cf4d551f-2adf-4a94-84d8-dc0e75b60088 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] [instance: f65c2cae-5950-4951-87eb-74afaf315b13] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:43.790762 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf4d551f-2adf-4a94-84d8-dc0e75b60088 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:43.793157 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf4d551f-2adf-4a94-84d8-dc0e75b60088 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:43.793964 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf4d551f-2adf-4a94-84d8-dc0e75b60088 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:43.796370 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf4d551f-2adf-4a94-84d8-dc0e75b60088 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:43.797106 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf4d551f-2adf-4a94-84d8-dc0e75b60088 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:43.797561 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf4d551f-2adf-4a94-84d8-dc0e75b60088 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:43.825995 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-cf4d551f-2adf-4a94-84d8-dc0e75b60088 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] HTTP exception thrown: Instance f65c2cae-5950-4951-87eb-74afaf315b13 could not be found. Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cf4d551f-2adf-4a94-84d8-dc0e75b60088 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Request method failure captured: Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 HTTP/1.1 Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HRbCUR_C8hjUySdIPrTFNyKUGhctyLXv9dXitHbvrEf2DnP7H0B0mCMu0-W8Y6NrHtGcADEDAWBHVxa-RJ0pXQ-Vj-F9xr_aH59G_3RoO2AVeojQgcgujnsp8z8BBjUSM333opPA2fBHZEjUfwGMUjj1XGurRNA4tDg2X9YkGJco9E Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: c4a56db115f64261ae4b472567a2265e Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesNegativeTest-265286901 Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:27:43.828070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:27:43.829501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c4a56db115f64261ae4b472567a2265e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c4a56db115f64261ae4b472567a2265e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c4a56db115f64261ae4b472567a2265e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c4a56db115f64261ae4b472567a2265e"}]}] Aug 08 02:27:43.829501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesNegativeTest-265286901 Aug 08 02:27:43.829501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: c4a56db115f64261ae4b472567a2265e Aug 08 02:27:43.829501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesNegativeTest-265286901 Aug 08 02:27:43.829501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesNegativeTest-265286901-project Aug 08 02:27:43.829501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:27:43.829501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:27:43.829501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 2b69dd6e1f7c4d93af3a27f310a7704c Aug 08 02:27:43.829501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesNegativeTest-265286901-project Aug 08 02:27:43.829501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:27:43.829501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance f65c2cae-5950-4951-87eb-74afaf315b13 could not be found. Aug 08 02:27:43.829501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': 'f65c2cae-5950-4951-87eb-74afaf315b13'} Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f65c2cae-5950-4951-87eb-74afaf315b13 could not be found. Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:27:43.830686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f65c2cae-5950-4951-87eb-74afaf315b13 could not be found. Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f65c2cae-5950-4951-87eb-74afaf315b13 could not be found. Aug 08 02:27:43.831718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:43.834166 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cf4d551f-2adf-4a94-84d8-dc0e75b60088 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] Returning 404 to user: Instance f65c2cae-5950-4951-87eb-74afaf315b13 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:27:43.836491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cf4d551f-2adf-4a94-84d8-dc0e75b60088 tempest-VolumesNegativeTest-265286901 tempest-VolumesNegativeTest-265286901-project] 10.222.0.39 "GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13" status: 404 len: 111 microversion: 2.1 time: 0.067125 Aug 08 02:27:43.837657 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 207/431] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:43 2022] GET /compute/v2.1/servers/f65c2cae-5950-4951-87eb-74afaf315b13 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:27:44.355262 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-665f03d2-be73-4e7e-99bc-5be6b7b2c965 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:44.356261 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-665f03d2-be73-4e7e-99bc-5be6b7b2c965 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:44.359530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:44.372288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-665f03d2-be73-4e7e-99bc-5be6b7b2c965 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:44.372781 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-665f03d2-be73-4e7e-99bc-5be6b7b2c965 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:44.373536 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-665f03d2-be73-4e7e-99bc-5be6b7b2c965 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:44.374274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-665f03d2-be73-4e7e-99bc-5be6b7b2c965 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:44.374710 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-665f03d2-be73-4e7e-99bc-5be6b7b2c965 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:44.377147 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-665f03d2-be73-4e7e-99bc-5be6b7b2c965 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:44.516997 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-665f03d2-be73-4e7e-99bc-5be6b7b2c965 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:44.530286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-665f03d2-be73-4e7e-99bc-5be6b7b2c965 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1272 microversion: 2.1 time: 0.188118 Aug 08 02:27:44.535026 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 225/432] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:44 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:44.581788 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2f7d4764-ea86-4b7c-84a2-f7f7eabc4265 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:27:44.584138 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2f7d4764-ea86-4b7c-84a2-f7f7eabc4265 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:44.591892 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f7d4764-ea86-4b7c-84a2-f7f7eabc4265 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:44.603162 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f7d4764-ea86-4b7c-84a2-f7f7eabc4265 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:44.606661 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f7d4764-ea86-4b7c-84a2-f7f7eabc4265 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:44.608588 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f7d4764-ea86-4b7c-84a2-f7f7eabc4265 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:44.609333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f7d4764-ea86-4b7c-84a2-f7f7eabc4265 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:44.609991 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f7d4764-ea86-4b7c-84a2-f7f7eabc4265 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:44.658539 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-2f7d4764-ea86-4b7c-84a2-f7f7eabc4265 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lazy-loading 'flavor' on Instance uuid 44b248f4-c0a5-4bf3-b424-5e953068e4a5 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:27:44.705549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:44.827813 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2f7d4764-ea86-4b7c-84a2-f7f7eabc4265 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "POST /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5/action" status: 200 len: 32 microversion: 2.1 time: 0.249953 Aug 08 02:27:44.829362 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 208/433] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:27:44 2022] POST /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5/action => generated 32 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 02:27:44.839511 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-477aca6c-4c33-456c-b983-da0b0e7f24a8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:44.847410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-477aca6c-4c33-456c-b983-da0b0e7f24a8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:44.857639 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-477aca6c-4c33-456c-b983-da0b0e7f24a8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:44.858130 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-477aca6c-4c33-456c-b983-da0b0e7f24a8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:44.861475 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-477aca6c-4c33-456c-b983-da0b0e7f24a8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:44.862429 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-477aca6c-4c33-456c-b983-da0b0e7f24a8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:44.862639 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-477aca6c-4c33-456c-b983-da0b0e7f24a8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:44.863611 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-477aca6c-4c33-456c-b983-da0b0e7f24a8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:45.428305 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-477aca6c-4c33-456c-b983-da0b0e7f24a8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:45.446468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-477aca6c-4c33-456c-b983-da0b0e7f24a8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1522 microversion: 2.1 time: 0.606327 Aug 08 02:27:45.458266 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 226/434] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:44 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1522 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:45.556463 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3bc88d78-9028-4805-81e1-7e0a4d68c29e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:45.557944 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3bc88d78-9028-4805-81e1-7e0a4d68c29e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:45.572455 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bc88d78-9028-4805-81e1-7e0a4d68c29e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:45.573545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bc88d78-9028-4805-81e1-7e0a4d68c29e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:45.576627 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bc88d78-9028-4805-81e1-7e0a4d68c29e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:45.577399 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bc88d78-9028-4805-81e1-7e0a4d68c29e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:45.577872 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bc88d78-9028-4805-81e1-7e0a4d68c29e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:45.578332 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bc88d78-9028-4805-81e1-7e0a4d68c29e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:45.934667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3bc88d78-9028-4805-81e1-7e0a4d68c29e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:45.959205 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3bc88d78-9028-4805-81e1-7e0a4d68c29e tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1314 microversion: 2.1 time: 0.407564 Aug 08 02:27:45.967983 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 209/435] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:45 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:46.471583 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-57899d79-ccce-48c4-8db8-eb8bb2cb6b4d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:46.472161 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-57899d79-ccce-48c4-8db8-eb8bb2cb6b4d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:46.482182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57899d79-ccce-48c4-8db8-eb8bb2cb6b4d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:46.482930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57899d79-ccce-48c4-8db8-eb8bb2cb6b4d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:46.483557 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57899d79-ccce-48c4-8db8-eb8bb2cb6b4d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:46.484267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57899d79-ccce-48c4-8db8-eb8bb2cb6b4d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:46.484722 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57899d79-ccce-48c4-8db8-eb8bb2cb6b4d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:46.485141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-57899d79-ccce-48c4-8db8-eb8bb2cb6b4d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:46.806622 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-57899d79-ccce-48c4-8db8-eb8bb2cb6b4d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:46.817802 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-57899d79-ccce-48c4-8db8-eb8bb2cb6b4d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1522 microversion: 2.1 time: 0.349918 Aug 08 02:27:46.818765 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 227/436] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:46 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:46.855199 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-622000fe-7a09-41fb-938c-76b5f8356616 req-fe2cb5f8-d100-4492-b649-54e8323cd7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dfe87d4-a556-46e2-be5d-81871c0c7ca4", "tag": "be2c512d-8e7d-4375-8d96-9611180c3fec"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:27:46.881603 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-622000fe-7a09-41fb-938c-76b5f8356616 req-fe2cb5f8-d100-4492-b649-54e8323cd7f6 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:46.883401 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-622000fe-7a09-41fb-938c-76b5f8356616 req-fe2cb5f8-d100-4492-b649-54e8323cd7f6 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:46.884554 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-622000fe-7a09-41fb-938c-76b5f8356616 req-fe2cb5f8-d100-4492-b649-54e8323cd7f6 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:46.901698 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-622000fe-7a09-41fb-938c-76b5f8356616 req-fe2cb5f8-d100-4492-b649-54e8323cd7f6 service nova] Creating event network-changed:be2c512d-8e7d-4375-8d96-9611180c3fec for instance 1dfe87d4-a556-46e2-be5d-81871c0c7ca4 on hv-cinder-73306 Aug 08 02:27:46.920040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-622000fe-7a09-41fb-938c-76b5f8356616 req-fe2cb5f8-d100-4492-b649-54e8323cd7f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071810 Aug 08 02:27:46.921374 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 210/437] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:27:46.982373 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-28e8c3d1-5263-419e-99a9-139104d70966 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:46.983214 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-28e8c3d1-5263-419e-99a9-139104d70966 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:46.991591 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-28e8c3d1-5263-419e-99a9-139104d70966 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:46.992161 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-28e8c3d1-5263-419e-99a9-139104d70966 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:46.992791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-28e8c3d1-5263-419e-99a9-139104d70966 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:46.993559 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-28e8c3d1-5263-419e-99a9-139104d70966 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:46.994192 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-28e8c3d1-5263-419e-99a9-139104d70966 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:46.994773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-28e8c3d1-5263-419e-99a9-139104d70966 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:47.208965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-28e8c3d1-5263-419e-99a9-139104d70966 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:47.220444 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-28e8c3d1-5263-419e-99a9-139104d70966 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1314 microversion: 2.1 time: 0.243773 Aug 08 02:27:47.235071 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 228/438] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:46 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:47.839740 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f1226882-59d8-4da3-906d-9ff2a15f868f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:47.840566 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f1226882-59d8-4da3-906d-9ff2a15f868f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:47.849882 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1226882-59d8-4da3-906d-9ff2a15f868f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:47.850410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1226882-59d8-4da3-906d-9ff2a15f868f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:47.850849 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1226882-59d8-4da3-906d-9ff2a15f868f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:47.851596 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1226882-59d8-4da3-906d-9ff2a15f868f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:47.851999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1226882-59d8-4da3-906d-9ff2a15f868f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:47.852427 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1226882-59d8-4da3-906d-9ff2a15f868f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:48.055384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f1226882-59d8-4da3-906d-9ff2a15f868f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:48.068153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f1226882-59d8-4da3-906d-9ff2a15f868f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1522 microversion: 2.1 time: 0.232914 Aug 08 02:27:48.069412 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 211/439] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:47 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:48.241755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7c0c8292-82da-4e4d-8256-8736b4da0395 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:48.242355 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7c0c8292-82da-4e4d-8256-8736b4da0395 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:48.250597 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7c0c8292-82da-4e4d-8256-8736b4da0395 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:48.251259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7c0c8292-82da-4e4d-8256-8736b4da0395 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:48.251889 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7c0c8292-82da-4e4d-8256-8736b4da0395 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:48.252740 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7c0c8292-82da-4e4d-8256-8736b4da0395 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:48.253329 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7c0c8292-82da-4e4d-8256-8736b4da0395 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:48.253889 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7c0c8292-82da-4e4d-8256-8736b4da0395 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:48.408152 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7c0c8292-82da-4e4d-8256-8736b4da0395 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:48.422617 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7c0c8292-82da-4e4d-8256-8736b4da0395 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1314 microversion: 2.1 time: 0.185451 Aug 08 02:27:48.423611 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 229/440] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:48 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:49.089759 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3784994f-3cf9-4a2a-bb84-5bbf11690bfd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:49.090433 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3784994f-3cf9-4a2a-bb84-5bbf11690bfd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:49.096538 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3784994f-3cf9-4a2a-bb84-5bbf11690bfd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:49.097342 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3784994f-3cf9-4a2a-bb84-5bbf11690bfd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:49.097857 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3784994f-3cf9-4a2a-bb84-5bbf11690bfd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:49.098662 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3784994f-3cf9-4a2a-bb84-5bbf11690bfd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:49.099139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3784994f-3cf9-4a2a-bb84-5bbf11690bfd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:49.099577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3784994f-3cf9-4a2a-bb84-5bbf11690bfd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:49.283876 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3784994f-3cf9-4a2a-bb84-5bbf11690bfd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:49.295330 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3784994f-3cf9-4a2a-bb84-5bbf11690bfd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1522 microversion: 2.1 time: 0.209178 Aug 08 02:27:49.295917 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 212/441] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:49 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:49.443391 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f7d899f6-ee4a-46d3-9cfe-67d50dd24819 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:49.444003 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f7d899f6-ee4a-46d3-9cfe-67d50dd24819 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:49.450275 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f7d899f6-ee4a-46d3-9cfe-67d50dd24819 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:49.451126 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f7d899f6-ee4a-46d3-9cfe-67d50dd24819 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:49.451757 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f7d899f6-ee4a-46d3-9cfe-67d50dd24819 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:49.452452 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f7d899f6-ee4a-46d3-9cfe-67d50dd24819 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:49.452902 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f7d899f6-ee4a-46d3-9cfe-67d50dd24819 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:49.453322 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f7d899f6-ee4a-46d3-9cfe-67d50dd24819 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:49.623177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f7d899f6-ee4a-46d3-9cfe-67d50dd24819 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:49.633649 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f7d899f6-ee4a-46d3-9cfe-67d50dd24819 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1314 microversion: 2.1 time: 0.194307 Aug 08 02:27:49.634226 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 230/442] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:49 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:50.319385 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1d5d16c1-486d-4fd5-9695-826fb03740eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:50.320829 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1d5d16c1-486d-4fd5-9695-826fb03740eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:50.328077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d5d16c1-486d-4fd5-9695-826fb03740eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:50.328673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d5d16c1-486d-4fd5-9695-826fb03740eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:50.329340 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d5d16c1-486d-4fd5-9695-826fb03740eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:50.330179 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d5d16c1-486d-4fd5-9695-826fb03740eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:50.331074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d5d16c1-486d-4fd5-9695-826fb03740eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:50.331614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d5d16c1-486d-4fd5-9695-826fb03740eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:50.601216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1d5d16c1-486d-4fd5-9695-826fb03740eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:50.610110 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1d5d16c1-486d-4fd5-9695-826fb03740eb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1522 microversion: 2.1 time: 0.296219 Aug 08 02:27:50.625474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 213/443] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:50 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:50.657721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-71cafc12-3adf-4fe8-b85f-40b1e9b04259 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:50.658492 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-71cafc12-3adf-4fe8-b85f-40b1e9b04259 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:50.665315 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-71cafc12-3adf-4fe8-b85f-40b1e9b04259 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:50.665923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-71cafc12-3adf-4fe8-b85f-40b1e9b04259 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:50.666524 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-71cafc12-3adf-4fe8-b85f-40b1e9b04259 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:50.667804 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-71cafc12-3adf-4fe8-b85f-40b1e9b04259 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:50.668373 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-71cafc12-3adf-4fe8-b85f-40b1e9b04259 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:50.668892 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-71cafc12-3adf-4fe8-b85f-40b1e9b04259 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:51.030828 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:51.046356 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-71cafc12-3adf-4fe8-b85f-40b1e9b04259 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:51.056248 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-71cafc12-3adf-4fe8-b85f-40b1e9b04259 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1314 microversion: 2.1 time: 0.401861 Aug 08 02:27:51.057443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 231/444] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:50 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:51.633617 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7e53dbf1-dd50-4c1c-bcb9-5be62cd1a698 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:51.634891 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7e53dbf1-dd50-4c1c-bcb9-5be62cd1a698 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:51.641531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:51.642603 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:51.645736 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e53dbf1-dd50-4c1c-bcb9-5be62cd1a698 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:51.647236 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e53dbf1-dd50-4c1c-bcb9-5be62cd1a698 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:51.648111 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e53dbf1-dd50-4c1c-bcb9-5be62cd1a698 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:51.649166 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e53dbf1-dd50-4c1c-bcb9-5be62cd1a698 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:51.650139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e53dbf1-dd50-4c1c-bcb9-5be62cd1a698 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:51.651809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e53dbf1-dd50-4c1c-bcb9-5be62cd1a698 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:51.872193 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7e53dbf1-dd50-4c1c-bcb9-5be62cd1a698 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:51.880780 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7e53dbf1-dd50-4c1c-bcb9-5be62cd1a698 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1522 microversion: 2.1 time: 0.252612 Aug 08 02:27:51.895066 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 214/445] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:51 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:52.078039 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b348fb67-3b91-48b7-b3e1-134cdb380856 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:52.078694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b348fb67-3b91-48b7-b3e1-134cdb380856 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:52.085612 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b348fb67-3b91-48b7-b3e1-134cdb380856 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:52.086377 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b348fb67-3b91-48b7-b3e1-134cdb380856 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:52.086960 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b348fb67-3b91-48b7-b3e1-134cdb380856 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:52.087822 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b348fb67-3b91-48b7-b3e1-134cdb380856 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:52.088880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b348fb67-3b91-48b7-b3e1-134cdb380856 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:52.089201 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b348fb67-3b91-48b7-b3e1-134cdb380856 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:52.236046 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b348fb67-3b91-48b7-b3e1-134cdb380856 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:52.245208 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b348fb67-3b91-48b7-b3e1-134cdb380856 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1314 microversion: 2.1 time: 0.170463 Aug 08 02:27:52.245780 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 232/446] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:52 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:52.903225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-be510bd2-a32c-4a31-adbb-5d088474d4bb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:52.903838 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-be510bd2-a32c-4a31-adbb-5d088474d4bb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:52.920437 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be510bd2-a32c-4a31-adbb-5d088474d4bb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:52.922543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be510bd2-a32c-4a31-adbb-5d088474d4bb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:52.923624 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be510bd2-a32c-4a31-adbb-5d088474d4bb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:52.923851 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be510bd2-a32c-4a31-adbb-5d088474d4bb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:52.924232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be510bd2-a32c-4a31-adbb-5d088474d4bb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:52.924731 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be510bd2-a32c-4a31-adbb-5d088474d4bb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:53.099924 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-be510bd2-a32c-4a31-adbb-5d088474d4bb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:53.109181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-be510bd2-a32c-4a31-adbb-5d088474d4bb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1522 microversion: 2.1 time: 0.209815 Aug 08 02:27:53.109991 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 215/447] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:52 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:53.266333 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2ee647a4-0c22-4fd4-8ad1-50402b4418a8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:53.267012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2ee647a4-0c22-4fd4-8ad1-50402b4418a8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:53.273715 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2ee647a4-0c22-4fd4-8ad1-50402b4418a8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:53.274428 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2ee647a4-0c22-4fd4-8ad1-50402b4418a8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:53.275242 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2ee647a4-0c22-4fd4-8ad1-50402b4418a8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:53.276133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2ee647a4-0c22-4fd4-8ad1-50402b4418a8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:53.276733 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2ee647a4-0c22-4fd4-8ad1-50402b4418a8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:53.277294 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2ee647a4-0c22-4fd4-8ad1-50402b4418a8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:53.467406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2ee647a4-0c22-4fd4-8ad1-50402b4418a8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:53.475462 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2ee647a4-0c22-4fd4-8ad1-50402b4418a8 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1314 microversion: 2.1 time: 0.213114 Aug 08 02:27:53.476339 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 233/448] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:53 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:53.856950 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-2a7b42f6-7243-49b6-9bb5-8e25c9b8c5e7 req-d4cdee04-fc74-4d34-b254-ad462c840e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dfe87d4-a556-46e2-be5d-81871c0c7ca4", "name": "network-vif-plugged", "status": "completed", "tag": "be2c512d-8e7d-4375-8d96-9611180c3fec"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:27:53.874897 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2a7b42f6-7243-49b6-9bb5-8e25c9b8c5e7 req-d4cdee04-fc74-4d34-b254-ad462c840e2e service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:53.875484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2a7b42f6-7243-49b6-9bb5-8e25c9b8c5e7 req-d4cdee04-fc74-4d34-b254-ad462c840e2e service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:53.876012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2a7b42f6-7243-49b6-9bb5-8e25c9b8c5e7 req-d4cdee04-fc74-4d34-b254-ad462c840e2e service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:53.888056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-2a7b42f6-7243-49b6-9bb5-8e25c9b8c5e7 req-d4cdee04-fc74-4d34-b254-ad462c840e2e service nova] Creating event network-vif-plugged:be2c512d-8e7d-4375-8d96-9611180c3fec for instance 1dfe87d4-a556-46e2-be5d-81871c0c7ca4 on hv-cinder-73306 Aug 08 02:27:53.893482 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-2a7b42f6-7243-49b6-9bb5-8e25c9b8c5e7 req-d4cdee04-fc74-4d34-b254-ad462c840e2e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040770 Aug 08 02:27:53.894663 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 216/449] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:27:54.131417 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d74d255a-88f0-46de-b008-61b5aa118fb7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:54.132033 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d74d255a-88f0-46de-b008-61b5aa118fb7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:54.138712 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d74d255a-88f0-46de-b008-61b5aa118fb7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:54.139212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d74d255a-88f0-46de-b008-61b5aa118fb7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:54.139856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d74d255a-88f0-46de-b008-61b5aa118fb7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:54.140729 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d74d255a-88f0-46de-b008-61b5aa118fb7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:54.141178 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d74d255a-88f0-46de-b008-61b5aa118fb7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:54.141598 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d74d255a-88f0-46de-b008-61b5aa118fb7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:54.285479 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d74d255a-88f0-46de-b008-61b5aa118fb7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:54.295823 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d74d255a-88f0-46de-b008-61b5aa118fb7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1522 microversion: 2.1 time: 0.168137 Aug 08 02:27:54.296527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 234/450] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:54 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:54.501237 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d7871d59-7068-41cf-8fee-d393c932cf46 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:54.502594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d7871d59-7068-41cf-8fee-d393c932cf46 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:54.511252 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7871d59-7068-41cf-8fee-d393c932cf46 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:54.512361 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7871d59-7068-41cf-8fee-d393c932cf46 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:54.512812 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7871d59-7068-41cf-8fee-d393c932cf46 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:54.513567 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7871d59-7068-41cf-8fee-d393c932cf46 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:54.514560 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7871d59-7068-41cf-8fee-d393c932cf46 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:54.515033 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7871d59-7068-41cf-8fee-d393c932cf46 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:54.676617 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d7871d59-7068-41cf-8fee-d393c932cf46 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:54.685641 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d7871d59-7068-41cf-8fee-d393c932cf46 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1314 microversion: 2.1 time: 0.192231 Aug 08 02:27:54.686205 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 217/451] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:54 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:55.196328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1672494351", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "networks": [{"uuid": "86ef2667-12f4-45f7-a1d6-3a60b9ae0cb9"}]}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:27:55.250860 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.network.neutron [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] validate_networks() for [('86ef2667-12f4-45f7-a1d6-3a60b9ae0cb9', None, None, None, None, None)] {{(pid=117640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:27:55.316985 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8ca8d5db-7394-4400-9e9f-80d1d22e7379 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:55.317910 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8ca8d5db-7394-4400-9e9f-80d1d22e7379 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:55.323983 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ca8d5db-7394-4400-9e9f-80d1d22e7379 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:55.324666 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ca8d5db-7394-4400-9e9f-80d1d22e7379 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:55.325103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ca8d5db-7394-4400-9e9f-80d1d22e7379 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:55.325959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ca8d5db-7394-4400-9e9f-80d1d22e7379 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:55.326416 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ca8d5db-7394-4400-9e9f-80d1d22e7379 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:55.326792 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ca8d5db-7394-4400-9e9f-80d1d22e7379 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:55.485500 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ca8d5db-7394-4400-9e9f-80d1d22e7379 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:55.497298 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8ca8d5db-7394-4400-9e9f-80d1d22e7379 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1522 microversion: 2.1 time: 0.184306 Aug 08 02:27:55.498236 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 218/452] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:55 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:55.633174 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Flavor limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:27:55.633713 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Image limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:27:55.634239 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Flavor pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:27:55.634780 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Image pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:27:55.635291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:27:55.645829 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:55.646452 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:55.646958 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:55.647750 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:55.648268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:55.648756 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:55.665846 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Getting quotas for project 2d75f4c0fe9148e7bf633a79dbfd6bb9. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:27:55.670631 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Getting quotas for user ef2ca1a30a76468cbe02b20efd6ca37e and project 2d75f4c0fe9148e7bf633a79dbfd6bb9. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:27:55.681770 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Going to run 1 instances... {{(pid=117640) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:27:55.684059 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:27:55.707394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a10fcb39-a08d-42a4-bf60-fe9835f919c5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:55.708772 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a10fcb39-a08d-42a4-bf60-fe9835f919c5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:55.718123 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a10fcb39-a08d-42a4-bf60-fe9835f919c5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:55.718782 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a10fcb39-a08d-42a4-bf60-fe9835f919c5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:55.719220 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a10fcb39-a08d-42a4-bf60-fe9835f919c5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:55.719916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a10fcb39-a08d-42a4-bf60-fe9835f919c5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:55.720362 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a10fcb39-a08d-42a4-bf60-fe9835f919c5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:55.720780 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a10fcb39-a08d-42a4-bf60-fe9835f919c5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:55.732100 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fac9495c-e7a1-42cd-86f2-e814a61f9f17 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539490 Aug 08 02:27:55.732748 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 235/453] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:27:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:27:55.743476 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2a7a9291-6bd3-472e-8140-0e9fe3f8284b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:55.744102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2a7a9291-6bd3-472e-8140-0e9fe3f8284b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:55.824611 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2a7a9291-6bd3-472e-8140-0e9fe3f8284b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:55.832501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2a7a9291-6bd3-472e-8140-0e9fe3f8284b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1219 microversion: 2.1 time: 0.092508 Aug 08 02:27:55.833175 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 236/454] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:55 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:55.888718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a10fcb39-a08d-42a4-bf60-fe9835f919c5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:55.897073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a10fcb39-a08d-42a4-bf60-fe9835f919c5 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1314 microversion: 2.1 time: 0.194010 Aug 08 02:27:55.897776 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 219/455] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:55 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:56.519239 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4ec27f88-0b1b-47d3-8dea-1f5f161e86b1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:56.520143 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4ec27f88-0b1b-47d3-8dea-1f5f161e86b1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:56.526458 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ec27f88-0b1b-47d3-8dea-1f5f161e86b1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:56.527442 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ec27f88-0b1b-47d3-8dea-1f5f161e86b1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:56.527880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ec27f88-0b1b-47d3-8dea-1f5f161e86b1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:56.528582 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ec27f88-0b1b-47d3-8dea-1f5f161e86b1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:56.529030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ec27f88-0b1b-47d3-8dea-1f5f161e86b1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:56.529446 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ec27f88-0b1b-47d3-8dea-1f5f161e86b1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:56.663411 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4ec27f88-0b1b-47d3-8dea-1f5f161e86b1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:56.671734 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4ec27f88-0b1b-47d3-8dea-1f5f161e86b1 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1502 microversion: 2.1 time: 0.157268 Aug 08 02:27:56.672291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 237/456] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:56 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:56.692223 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f924ce12-2543-494b-ba85-19e8a7086dca tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61b290ec-0298-4e08-bf04-67e1dd9c68ee"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:27:56.694552 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f924ce12-2543-494b-ba85-19e8a7086dca tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:56.700448 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f924ce12-2543-494b-ba85-19e8a7086dca tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:56.700926 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f924ce12-2543-494b-ba85-19e8a7086dca tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:56.701358 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f924ce12-2543-494b-ba85-19e8a7086dca tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:56.702039 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f924ce12-2543-494b-ba85-19e8a7086dca tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:56.702568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f924ce12-2543-494b-ba85-19e8a7086dca tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:56.703050 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f924ce12-2543-494b-ba85-19e8a7086dca tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:56.725658 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-f924ce12-2543-494b-ba85-19e8a7086dca tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] HTTP exception thrown: Cannot 'attach_volume' instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 while it is in vm_state rescued Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f924ce12-2543-494b-ba85-19e8a7086dca tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Request method failure captured: Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: POST /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5/os-volume_attachments HTTP/1.1 Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 74 Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQj7nZ596tyWWWEdcaGznu-Z4Br4Pom5I2-PAdLAUN_l4GI5DRgq5KfI9Fl4w_rhUMWFPKnZ3O16ZNtof9AdmY2rGF26JlAQcLDANOgMx4S2l8JMiyb147J-pdIPWo7r6B24FrJ8_yahhcB2zBycszIcITthdplKZyyjWZU9pJnJXE Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 12bf9f0d74de4a57918b688a6d969b28 Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:27:56.727349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:27:56.728896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12bf9f0d74de4a57918b688a6d969b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12bf9f0d74de4a57918b688a6d969b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12bf9f0d74de4a57918b688a6d969b28", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12bf9f0d74de4a57918b688a6d969b28"}]}] Aug 08 02:27:56.728896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:27:56.728896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 12bf9f0d74de4a57918b688a6d969b28 Aug 08 02:27:56.728896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:27:56.728896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-ServerRescueNegativeTestJSON-561377719-project Aug 08 02:27:56.728896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:27:56.728896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:27:56.728896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 1fd1b40cbd884915bdfac150f9718e32 Aug 08 02:27:56.728896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-561377719-project Aug 08 02:27:56.728896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Aug 08 02:27:56.728896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {"volumeAttachment": {"volumeId": "61b290ec-0298-4e08-bf04-67e1dd9c68ee"}} Aug 08 02:27:56.728896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Cannot 'attach_volume' instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 while it is in vm_state rescued Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'server_id': '44b248f4-c0a5-4bf3-b424-5e953068e4a5', 'body': {'volumeAttachment': {'volumeId': '61b290ec-0298-4e08-bf04-67e1dd9c68ee'}}} Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:27:56.729913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 while it is in vm_state rescued Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:27:56.731993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:27:56.733103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:27:56.733103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:27:56.733103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 while it is in vm_state rescued Aug 08 02:27:56.733103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:27:56.733103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f924ce12-2543-494b-ba85-19e8a7086dca tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Returning 409 to user: Cannot 'attach_volume' instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 while it is in vm_state rescued {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:27:56.733103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f924ce12-2543-494b-ba85-19e8a7086dca tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "POST /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040951 Aug 08 02:27:56.733103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 220/457] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:27:56 2022] POST /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 02:27:56.739022 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8ed27161-9513-4c6a-92b4-2e40a38df843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:27:56.739586 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8ed27161-9513-4c6a-92b4-2e40a38df843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:56.745459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8ed27161-9513-4c6a-92b4-2e40a38df843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:56.745937 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8ed27161-9513-4c6a-92b4-2e40a38df843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:56.746399 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8ed27161-9513-4c6a-92b4-2e40a38df843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:56.747086 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8ed27161-9513-4c6a-92b4-2e40a38df843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:56.747542 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8ed27161-9513-4c6a-92b4-2e40a38df843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:56.747966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8ed27161-9513-4c6a-92b4-2e40a38df843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:56.751556 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:56.813200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8ed27161-9513-4c6a-92b4-2e40a38df843 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "POST /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5/action" status: 202 len: 0 microversion: 2.1 time: 0.078171 Aug 08 02:27:56.814142 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 238/458] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:27:56 2022] POST /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:27:56.822207 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-38b53cb0-f8d6-4d15-aba8-d95991f25365 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:56.822846 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-38b53cb0-f8d6-4d15-aba8-d95991f25365 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:56.828963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38b53cb0-f8d6-4d15-aba8-d95991f25365 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:56.829441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38b53cb0-f8d6-4d15-aba8-d95991f25365 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:56.829903 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38b53cb0-f8d6-4d15-aba8-d95991f25365 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:56.830822 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38b53cb0-f8d6-4d15-aba8-d95991f25365 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:56.831352 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38b53cb0-f8d6-4d15-aba8-d95991f25365 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:56.831790 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-38b53cb0-f8d6-4d15-aba8-d95991f25365 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:56.856036 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-56822144-ad53-4001-9893-2e77390c8df5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:56.856745 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-56822144-ad53-4001-9893-2e77390c8df5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:56.863777 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56822144-ad53-4001-9893-2e77390c8df5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:56.864263 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56822144-ad53-4001-9893-2e77390c8df5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:56.864698 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56822144-ad53-4001-9893-2e77390c8df5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:56.865478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56822144-ad53-4001-9893-2e77390c8df5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:56.866013 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56822144-ad53-4001-9893-2e77390c8df5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:56.866546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56822144-ad53-4001-9893-2e77390c8df5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:56.932416 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-56822144-ad53-4001-9893-2e77390c8df5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:56.940269 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-56822144-ad53-4001-9893-2e77390c8df5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1223 microversion: 2.1 time: 0.090917 Aug 08 02:27:56.940853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 239/459] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:56 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:56.945583 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9cd1f5d6-e716-4ff6-8da0-b1b82429d418 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:56.946123 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9cd1f5d6-e716-4ff6-8da0-b1b82429d418 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:56.952881 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9cd1f5d6-e716-4ff6-8da0-b1b82429d418 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:56.954011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9cd1f5d6-e716-4ff6-8da0-b1b82429d418 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:56.954484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9cd1f5d6-e716-4ff6-8da0-b1b82429d418 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:56.955523 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9cd1f5d6-e716-4ff6-8da0-b1b82429d418 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:56.955986 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9cd1f5d6-e716-4ff6-8da0-b1b82429d418 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:56.956411 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9cd1f5d6-e716-4ff6-8da0-b1b82429d418 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:56.983436 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-38b53cb0-f8d6-4d15-aba8-d95991f25365 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:56.992979 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-38b53cb0-f8d6-4d15-aba8-d95991f25365 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1510 microversion: 2.1 time: 0.174601 Aug 08 02:27:56.994295 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 221/460] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:56 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:57.106450 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-9cd1f5d6-e716-4ff6-8da0-b1b82429d418 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:57.113798 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9cd1f5d6-e716-4ff6-8da0-b1b82429d418 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1499 microversion: 2.1 time: 0.171987 Aug 08 02:27:57.114391 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 240/461] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:56 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1499 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:57.699718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8b888df3-08fd-4d50-a867-bc47d659fde0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:57.700214 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8b888df3-08fd-4d50-a867-bc47d659fde0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:57.706369 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b888df3-08fd-4d50-a867-bc47d659fde0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:57.707212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b888df3-08fd-4d50-a867-bc47d659fde0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:57.707771 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b888df3-08fd-4d50-a867-bc47d659fde0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:57.708582 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b888df3-08fd-4d50-a867-bc47d659fde0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:57.709135 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b888df3-08fd-4d50-a867-bc47d659fde0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:57.709771 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b888df3-08fd-4d50-a867-bc47d659fde0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:57.741030 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8b888df3-08fd-4d50-a867-bc47d659fde0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:27:57.824822 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8b888df3-08fd-4d50-a867-bc47d659fde0 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 204 len: 0 microversion: 2.1 time: 0.129516 Aug 08 02:27:57.825394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 222/462] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:27:57 2022] DELETE /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:27:57.833389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-262a9613-f971-41fd-b060-44652df721e4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:57.834009 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-262a9613-f971-41fd-b060-44652df721e4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:57.839961 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-262a9613-f971-41fd-b060-44652df721e4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:57.840441 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-262a9613-f971-41fd-b060-44652df721e4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:57.840874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-262a9613-f971-41fd-b060-44652df721e4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:57.841561 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-262a9613-f971-41fd-b060-44652df721e4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:57.842015 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-262a9613-f971-41fd-b060-44652df721e4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:57.842584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-262a9613-f971-41fd-b060-44652df721e4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:57.963261 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bbec4a7c-0a72-4158-87b3-701c0527426c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:57.963972 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bbec4a7c-0a72-4158-87b3-701c0527426c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:57.970987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbec4a7c-0a72-4158-87b3-701c0527426c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:57.971445 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbec4a7c-0a72-4158-87b3-701c0527426c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:57.971899 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbec4a7c-0a72-4158-87b3-701c0527426c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:57.972584 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbec4a7c-0a72-4158-87b3-701c0527426c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:57.973024 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbec4a7c-0a72-4158-87b3-701c0527426c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:57.973437 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbec4a7c-0a72-4158-87b3-701c0527426c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:57.973709 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-262a9613-f971-41fd-b060-44652df721e4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:57.984463 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-262a9613-f971-41fd-b060-44652df721e4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1505 microversion: 2.1 time: 0.154766 Aug 08 02:27:57.985041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 241/463] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:57 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:58.020979 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c6c00830-f7a8-47cc-b057-e0001537f3cf tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:58.021920 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c6c00830-f7a8-47cc-b057-e0001537f3cf tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:58.032170 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c6c00830-f7a8-47cc-b057-e0001537f3cf tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:58.032802 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c6c00830-f7a8-47cc-b057-e0001537f3cf tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:58.033300 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c6c00830-f7a8-47cc-b057-e0001537f3cf tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:58.038412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c6c00830-f7a8-47cc-b057-e0001537f3cf tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:58.040712 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c6c00830-f7a8-47cc-b057-e0001537f3cf tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:58.044419 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c6c00830-f7a8-47cc-b057-e0001537f3cf tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:58.070427 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bbec4a7c-0a72-4158-87b3-701c0527426c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:58.074672 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:27:58.081166 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bbec4a7c-0a72-4158-87b3-701c0527426c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1271 microversion: 2.1 time: 0.123393 Aug 08 02:27:58.082063 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 223/464] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:57 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:58.217455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c6c00830-f7a8-47cc-b057-e0001537f3cf tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:58.225465 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c6c00830-f7a8-47cc-b057-e0001537f3cf tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1510 microversion: 2.1 time: 0.214202 Aug 08 02:27:58.226049 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 242/465] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:58 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:59.005269 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-88ca7557-df9a-4533-a89f-198819048d1f tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:59.005898 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-88ca7557-df9a-4533-a89f-198819048d1f tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:59.013394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88ca7557-df9a-4533-a89f-198819048d1f tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:59.013872 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88ca7557-df9a-4533-a89f-198819048d1f tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:59.014329 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88ca7557-df9a-4533-a89f-198819048d1f tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:59.015018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88ca7557-df9a-4533-a89f-198819048d1f tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:59.015467 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88ca7557-df9a-4533-a89f-198819048d1f tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:59.015883 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88ca7557-df9a-4533-a89f-198819048d1f tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:59.106366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-64ffa294-52d0-4d4e-9317-5efc75a3bfc5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:59.106973 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-64ffa294-52d0-4d4e-9317-5efc75a3bfc5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:59.112761 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-64ffa294-52d0-4d4e-9317-5efc75a3bfc5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:59.113233 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-64ffa294-52d0-4d4e-9317-5efc75a3bfc5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:59.113657 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-64ffa294-52d0-4d4e-9317-5efc75a3bfc5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:59.114358 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-64ffa294-52d0-4d4e-9317-5efc75a3bfc5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:59.114808 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-64ffa294-52d0-4d4e-9317-5efc75a3bfc5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:59.115274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-64ffa294-52d0-4d4e-9317-5efc75a3bfc5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:59.148668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-88ca7557-df9a-4533-a89f-198819048d1f tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:59.156129 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-88ca7557-df9a-4533-a89f-198819048d1f tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1505 microversion: 2.1 time: 0.155052 Aug 08 02:27:59.156694 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 224/466] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:58 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:27:59.178393 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-64ffa294-52d0-4d4e-9317-5efc75a3bfc5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:59.186683 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-64ffa294-52d0-4d4e-9317-5efc75a3bfc5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1279 microversion: 2.1 time: 0.084111 Aug 08 02:27:59.187246 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 243/467] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:59 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1279 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:27:59.247708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0a173318-e8c0-4822-b8c7-4c1c813e0ae3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:27:59.248282 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0a173318-e8c0-4822-b8c7-4c1c813e0ae3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:27:59.254092 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a173318-e8c0-4822-b8c7-4c1c813e0ae3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:59.254601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a173318-e8c0-4822-b8c7-4c1c813e0ae3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:59.255029 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a173318-e8c0-4822-b8c7-4c1c813e0ae3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:59.255704 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a173318-e8c0-4822-b8c7-4c1c813e0ae3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:27:59.256148 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a173318-e8c0-4822-b8c7-4c1c813e0ae3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:27:59.256597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a173318-e8c0-4822-b8c7-4c1c813e0ae3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:27:59.388000 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0a173318-e8c0-4822-b8c7-4c1c813e0ae3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:27:59.395752 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0a173318-e8c0-4822-b8c7-4c1c813e0ae3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1510 microversion: 2.1 time: 0.152538 Aug 08 02:27:59.396566 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 225/468] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:27:59 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:00.177309 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dbef96f9-344b-42c7-9ec7-fd56d841c7c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:00.178140 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-dbef96f9-344b-42c7-9ec7-fd56d841c7c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:00.184151 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dbef96f9-344b-42c7-9ec7-fd56d841c7c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:00.184624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dbef96f9-344b-42c7-9ec7-fd56d841c7c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:00.185045 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dbef96f9-344b-42c7-9ec7-fd56d841c7c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:00.185724 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dbef96f9-344b-42c7-9ec7-fd56d841c7c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:00.186162 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dbef96f9-344b-42c7-9ec7-fd56d841c7c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:00.186603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dbef96f9-344b-42c7-9ec7-fd56d841c7c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:00.208369 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ec675a6f-55af-4be7-a159-83a24058246c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:00.209569 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ec675a6f-55af-4be7-a159-83a24058246c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:00.217325 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec675a6f-55af-4be7-a159-83a24058246c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:00.217853 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec675a6f-55af-4be7-a159-83a24058246c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:00.218336 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec675a6f-55af-4be7-a159-83a24058246c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:00.219049 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec675a6f-55af-4be7-a159-83a24058246c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:00.219504 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec675a6f-55af-4be7-a159-83a24058246c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:00.219928 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec675a6f-55af-4be7-a159-83a24058246c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:00.281770 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ec675a6f-55af-4be7-a159-83a24058246c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:00.289312 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ec675a6f-55af-4be7-a159-83a24058246c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1277 microversion: 2.1 time: 0.085397 Aug 08 02:28:00.289888 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 226/469] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:00 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:28:00.417042 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a5c0fc61-139d-4037-9f29-e93827d0457a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:00.418034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a5c0fc61-139d-4037-9f29-e93827d0457a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:00.424331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5c0fc61-139d-4037-9f29-e93827d0457a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:00.424820 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5c0fc61-139d-4037-9f29-e93827d0457a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:00.425259 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5c0fc61-139d-4037-9f29-e93827d0457a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:00.425962 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5c0fc61-139d-4037-9f29-e93827d0457a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:00.426450 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5c0fc61-139d-4037-9f29-e93827d0457a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:00.426877 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5c0fc61-139d-4037-9f29-e93827d0457a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:00.527383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-dbef96f9-344b-42c7-9ec7-fd56d841c7c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:00.535848 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-dbef96f9-344b-42c7-9ec7-fd56d841c7c4 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1505 microversion: 2.1 time: 0.362421 Aug 08 02:28:00.547964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 244/470] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:00 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:00.572373 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a5c0fc61-139d-4037-9f29-e93827d0457a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:00.581012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a5c0fc61-139d-4037-9f29-e93827d0457a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1510 microversion: 2.1 time: 0.167929 Aug 08 02:28:00.581686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 227/471] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:00 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:28:00.920587 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-ee2ec809-52b3-4328-b7c7-ff05da099bd2 req-d51fbecd-feda-47a2-ba5b-dfc9d1b8c4db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dfe87d4-a556-46e2-be5d-81871c0c7ca4", "name": "network-vif-deleted", "tag": "be2c512d-8e7d-4375-8d96-9611180c3fec"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:28:00.930582 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-ee2ec809-52b3-4328-b7c7-ff05da099bd2 req-d51fbecd-feda-47a2-ba5b-dfc9d1b8c4db service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:00.931048 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-ee2ec809-52b3-4328-b7c7-ff05da099bd2 req-d51fbecd-feda-47a2-ba5b-dfc9d1b8c4db service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:00.931467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-ee2ec809-52b3-4328-b7c7-ff05da099bd2 req-d51fbecd-feda-47a2-ba5b-dfc9d1b8c4db service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:00.943549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-ee2ec809-52b3-4328-b7c7-ff05da099bd2 req-d51fbecd-feda-47a2-ba5b-dfc9d1b8c4db service nova] Creating event network-vif-deleted:be2c512d-8e7d-4375-8d96-9611180c3fec for instance 1dfe87d4-a556-46e2-be5d-81871c0c7ca4 on hv-cinder-73306 Aug 08 02:28:00.949024 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-ee2ec809-52b3-4328-b7c7-ff05da099bd2 req-d51fbecd-feda-47a2-ba5b-dfc9d1b8c4db service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033002 Aug 08 02:28:00.949687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 245/472] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:28:01.310156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7c28db55-ce08-4a5a-adbe-43b465fc11bc tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:01.310881 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7c28db55-ce08-4a5a-adbe-43b465fc11bc tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:01.319057 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c28db55-ce08-4a5a-adbe-43b465fc11bc tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:01.319538 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c28db55-ce08-4a5a-adbe-43b465fc11bc tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:01.320015 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c28db55-ce08-4a5a-adbe-43b465fc11bc tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:01.320639 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c28db55-ce08-4a5a-adbe-43b465fc11bc tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:01.321085 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c28db55-ce08-4a5a-adbe-43b465fc11bc tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:01.321500 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c28db55-ce08-4a5a-adbe-43b465fc11bc tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:01.449344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7c28db55-ce08-4a5a-adbe-43b465fc11bc tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:01.456626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7c28db55-ce08-4a5a-adbe-43b465fc11bc tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.150418 Aug 08 02:28:01.457301 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 228/473] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:01 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:01.557805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-71b591fd-a391-4b49-a4c8-488392a4f21b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:01.558558 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-71b591fd-a391-4b49-a4c8-488392a4f21b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:01.565334 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-71b591fd-a391-4b49-a4c8-488392a4f21b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:01.565878 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-71b591fd-a391-4b49-a4c8-488392a4f21b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:01.566318 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-71b591fd-a391-4b49-a4c8-488392a4f21b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:01.567014 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-71b591fd-a391-4b49-a4c8-488392a4f21b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:01.567475 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-71b591fd-a391-4b49-a4c8-488392a4f21b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:01.567893 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-71b591fd-a391-4b49-a4c8-488392a4f21b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:01.601662 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b4fafedf-d206-4817-9344-ee41f5681309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:01.602296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b4fafedf-d206-4817-9344-ee41f5681309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:01.608709 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b4fafedf-d206-4817-9344-ee41f5681309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:01.609280 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b4fafedf-d206-4817-9344-ee41f5681309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:01.609793 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b4fafedf-d206-4817-9344-ee41f5681309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:01.610595 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b4fafedf-d206-4817-9344-ee41f5681309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:01.611057 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b4fafedf-d206-4817-9344-ee41f5681309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:01.611513 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b4fafedf-d206-4817-9344-ee41f5681309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:01.632713 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-71b591fd-a391-4b49-a4c8-488392a4f21b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:01.641041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-71b591fd-a391-4b49-a4c8-488392a4f21b tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1463 microversion: 2.1 time: 0.087742 Aug 08 02:28:01.641607 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 246/474] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:01 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1463 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:01.742109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b4fafedf-d206-4817-9344-ee41f5681309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:01.750075 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b4fafedf-d206-4817-9344-ee41f5681309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1510 microversion: 2.1 time: 0.152296 Aug 08 02:28:01.750667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 229/475] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:01 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:28:02.477964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-06ac3c6f-7f5a-4470-bd26-2d90a83349da tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:02.478587 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-06ac3c6f-7f5a-4470-bd26-2d90a83349da tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:02.485844 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-06ac3c6f-7f5a-4470-bd26-2d90a83349da tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:02.486612 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-06ac3c6f-7f5a-4470-bd26-2d90a83349da tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:02.487229 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-06ac3c6f-7f5a-4470-bd26-2d90a83349da tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:02.488143 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-06ac3c6f-7f5a-4470-bd26-2d90a83349da tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:02.489054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-06ac3c6f-7f5a-4470-bd26-2d90a83349da tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:02.489680 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-06ac3c6f-7f5a-4470-bd26-2d90a83349da tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:02.664411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:02.665378 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:02.673138 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:02.673843 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:02.674920 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:02.681463 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:02.682857 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:02.685331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:02.728103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:02.728823 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:02.729369 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:02.730524 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lazy-loading 'fault' on Instance uuid 1dfe87d4-a556-46e2-be5d-81871c0c7ca4 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:28:02.731496 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-06ac3c6f-7f5a-4470-bd26-2d90a83349da tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:02.739497 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-06ac3c6f-7f5a-4470-bd26-2d90a83349da tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.265268 Aug 08 02:28:02.740681 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 247/476] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:02 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:02.771270 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0b71b43c-fc9b-4841-8716-78a4e0564763 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:02.772172 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0b71b43c-fc9b-4841-8716-78a4e0564763 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:02.778812 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b71b43c-fc9b-4841-8716-78a4e0564763 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:02.779485 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b71b43c-fc9b-4841-8716-78a4e0564763 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:02.780135 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b71b43c-fc9b-4841-8716-78a4e0564763 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:02.781155 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b71b43c-fc9b-4841-8716-78a4e0564763 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:02.781757 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b71b43c-fc9b-4841-8716-78a4e0564763 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:02.782366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b71b43c-fc9b-4841-8716-78a4e0564763 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:02.786096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6916c2afef12490f921d99c5047b4dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cc8b8bc4964df4a494173af8540c45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:02.794731 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-567e06b5-958e-4e39-91d9-236d7f84a0a9 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 200 len: 1304 microversion: 2.1 time: 0.135617 Aug 08 02:28:02.796005 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 230/477] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:02 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:02.991727 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0b71b43c-fc9b-4841-8716-78a4e0564763 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:03.002783 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0b71b43c-fc9b-4841-8716-78a4e0564763 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1516 microversion: 2.1 time: 0.235225 Aug 08 02:28:03.014872 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 248/478] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:02 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:28:03.256374 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-1b50a86b-722d-4691-a203-f4566d8663e6 req-a8122b9e-3205-4104-a27a-3b93199c677f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ea1a9c-fd55-4d21-909a-235e4422e6d6", "tag": "eac6eba0-4fcb-45b9-8708-de73198d3388"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:28:03.272273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-1b50a86b-722d-4691-a203-f4566d8663e6 req-a8122b9e-3205-4104-a27a-3b93199c677f service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:03.273597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-1b50a86b-722d-4691-a203-f4566d8663e6 req-a8122b9e-3205-4104-a27a-3b93199c677f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:03.274877 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-1b50a86b-722d-4691-a203-f4566d8663e6 req-a8122b9e-3205-4104-a27a-3b93199c677f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:03.288760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-1b50a86b-722d-4691-a203-f4566d8663e6 req-a8122b9e-3205-4104-a27a-3b93199c677f service nova] Creating event network-changed:eac6eba0-4fcb-45b9-8708-de73198d3388 for instance f1ea1a9c-fd55-4d21-909a-235e4422e6d6 on hv-cinder-73306 Aug 08 02:28:03.294234 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-1b50a86b-722d-4691-a203-f4566d8663e6 req-a8122b9e-3205-4104-a27a-3b93199c677f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043427 Aug 08 02:28:03.295053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 231/479] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:28:03.760120 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5a25296e-c825-42ba-aa61-0db77add972f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:03.760727 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5a25296e-c825-42ba-aa61-0db77add972f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:03.767361 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a25296e-c825-42ba-aa61-0db77add972f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:03.767847 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a25296e-c825-42ba-aa61-0db77add972f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:03.768481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a25296e-c825-42ba-aa61-0db77add972f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:03.769173 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a25296e-c825-42ba-aa61-0db77add972f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:03.769781 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a25296e-c825-42ba-aa61-0db77add972f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:03.770200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a25296e-c825-42ba-aa61-0db77add972f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:03.818464 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d50ff557-192d-4fa3-a6f5-71337efa96c3 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:03.820277 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d50ff557-192d-4fa3-a6f5-71337efa96c3 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] [instance: 1dfe87d4-a556-46e2-be5d-81871c0c7ca4] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:03.830175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d50ff557-192d-4fa3-a6f5-71337efa96c3 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:03.830698 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d50ff557-192d-4fa3-a6f5-71337efa96c3 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:03.831299 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d50ff557-192d-4fa3-a6f5-71337efa96c3 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:03.832157 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d50ff557-192d-4fa3-a6f5-71337efa96c3 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:03.832976 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d50ff557-192d-4fa3-a6f5-71337efa96c3 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:03.833430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d50ff557-192d-4fa3-a6f5-71337efa96c3 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:03.848708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-d50ff557-192d-4fa3-a6f5-71337efa96c3 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] HTTP exception thrown: Instance 1dfe87d4-a556-46e2-be5d-81871c0c7ca4 could not be found. Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d50ff557-192d-4fa3-a6f5-71337efa96c3 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Request method failure captured: Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 HTTP/1.1 Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HRMi9U8RELfedsGqQhDhz667nMlOxQ2jS0iEWmwzgMkBoSrKOknAr_V9ez1Mf12a72d2dOhqpr46xiEVhJIJpTLax74iSZTnhyFbZSmAqY_hltbx5eWpiTM--68KNfXn8Z4MSI4MzfjAuHo2hhAQiefcKwuh0TGA-p0lZM14nCJpug Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: d3cc8b8bc4964df4a494173af8540c45 Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesActionsTest-1493641150 Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:28:03.850586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:28:03.852074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d3cc8b8bc4964df4a494173af8540c45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d3cc8b8bc4964df4a494173af8540c45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d3cc8b8bc4964df4a494173af8540c45", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d3cc8b8bc4964df4a494173af8540c45"}]}] Aug 08 02:28:03.852074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesActionsTest-1493641150 Aug 08 02:28:03.852074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: d3cc8b8bc4964df4a494173af8540c45 Aug 08 02:28:03.852074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesActionsTest-1493641150 Aug 08 02:28:03.852074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesActionsTest-1493641150-project Aug 08 02:28:03.852074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:28:03.852074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:28:03.852074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 6916c2afef12490f921d99c5047b4dce Aug 08 02:28:03.852074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesActionsTest-1493641150-project Aug 08 02:28:03.852074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:28:03.852074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 1dfe87d4-a556-46e2-be5d-81871c0c7ca4 could not be found. Aug 08 02:28:03.852074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '1dfe87d4-a556-46e2-be5d-81871c0c7ca4'} Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dfe87d4-a556-46e2-be5d-81871c0c7ca4 could not be found. Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:28:03.852880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dfe87d4-a556-46e2-be5d-81871c0c7ca4 could not be found. Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dfe87d4-a556-46e2-be5d-81871c0c7ca4 could not be found. Aug 08 02:28:03.854035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:28:03.855604 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d50ff557-192d-4fa3-a6f5-71337efa96c3 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] Returning 404 to user: Instance 1dfe87d4-a556-46e2-be5d-81871c0c7ca4 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:28:03.855604 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d50ff557-192d-4fa3-a6f5-71337efa96c3 tempest-VolumesActionsTest-1493641150 tempest-VolumesActionsTest-1493641150-project] 10.222.0.39 "GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4" status: 404 len: 111 microversion: 2.1 time: 0.038920 Aug 08 02:28:03.855604 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 232/480] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:03 2022] GET /compute/v2.1/servers/1dfe87d4-a556-46e2-be5d-81871c0c7ca4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:28:04.163901 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5a25296e-c825-42ba-aa61-0db77add972f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:04.173381 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5a25296e-c825-42ba-aa61-0db77add972f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.416892 Aug 08 02:28:04.175132 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 249/481] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:03 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:04.503615 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-52cc0642-f8bf-4a09-a98f-aee311ac7b46 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Action: 'create', calling method: .version_select at 0x7f3295b3a550>, body: {"keypair": {"name": "tempest-keypair-377395412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACHPiJwDNNEQP0n89EdYo11rKqTVVOsduXgks70RHVk7FU+u3792Zm+dfK9QV9eEcJg4hOLkR9biG1h7mBHE9gAjzWWnBiyz5AvnN5jwol2QNF08fvEU/rl5PVf63jhAw=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:28:04.521461 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-52cc0642-f8bf-4a09-a98f-aee311ac7b46 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Getting quotas for project 12bf9f0d74de4a57918b688a6d969b28. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:28:04.526192 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-52cc0642-f8bf-4a09-a98f-aee311ac7b46 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Getting quotas for user 1fd1b40cbd884915bdfac150f9718e32 and project 12bf9f0d74de4a57918b688a6d969b28. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:28:04.558760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-52cc0642-f8bf-4a09-a98f-aee311ac7b46 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058781 Aug 08 02:28:04.559699 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 233/482] 10.222.0.39 () {60 vars in 1159 bytes} [Mon Aug 8 02:28:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:28:05.197904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fdc04464-a79a-45fa-9241-7b71ae97de32 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:05.198759 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-fdc04464-a79a-45fa-9241-7b71ae97de32 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:05.205488 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fdc04464-a79a-45fa-9241-7b71ae97de32 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:05.206049 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fdc04464-a79a-45fa-9241-7b71ae97de32 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:05.206584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fdc04464-a79a-45fa-9241-7b71ae97de32 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:05.207335 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fdc04464-a79a-45fa-9241-7b71ae97de32 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:05.207850 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fdc04464-a79a-45fa-9241-7b71ae97de32 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:05.208333 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fdc04464-a79a-45fa-9241-7b71ae97de32 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:05.437629 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-fdc04464-a79a-45fa-9241-7b71ae97de32 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:05.445496 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fdc04464-a79a-45fa-9241-7b71ae97de32 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.251886 Aug 08 02:28:05.446066 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 250/483] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:05 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:28:06.060142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1942447170", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47880f00-89cc-4f2f-a53b-fc4029eccb32"}], "security_groups": [{"name": "tempest-securitygroup--2042846330"}], "key_name": "tempest-keypair-377395412", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:28:06.170583 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] validate_networks() for [('47880f00-89cc-4f2f-a53b-fc4029eccb32', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:28:06.466149 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-326b016e-94c6-4dc3-9d56-14f6f1dd59d4 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:06.466900 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-326b016e-94c6-4dc3-9d56-14f6f1dd59d4 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:06.469787 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:06.470597 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=8 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:06.474639 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-326b016e-94c6-4dc3-9d56-14f6f1dd59d4 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:06.475146 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-326b016e-94c6-4dc3-9d56-14f6f1dd59d4 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:06.475636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-326b016e-94c6-4dc3-9d56-14f6f1dd59d4 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:06.476365 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-326b016e-94c6-4dc3-9d56-14f6f1dd59d4 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:06.476815 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-326b016e-94c6-4dc3-9d56-14f6f1dd59d4 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:06.477238 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-326b016e-94c6-4dc3-9d56-14f6f1dd59d4 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:06.542395 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:28:06.542947 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:28:06.543403 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:28:06.543913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:28:06.544354 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:28:06.553257 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:06.553763 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:06.554196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:06.554950 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:06.555397 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:06.555816 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:06.573307 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Getting quotas for project 12bf9f0d74de4a57918b688a6d969b28. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:28:06.577859 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Getting quotas for user 1fd1b40cbd884915bdfac150f9718e32 and project 12bf9f0d74de4a57918b688a6d969b28. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:28:06.588686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:28:06.591088 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:28:06.612808 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-326b016e-94c6-4dc3-9d56-14f6f1dd59d4 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:06.620200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-326b016e-94c6-4dc3-9d56-14f6f1dd59d4 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.157868 Aug 08 02:28:06.621503 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 251/484] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:06 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:28:06.637811 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-59c546d7-4e5e-44f2-9fe5-31fd6159a3de tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.582075 Aug 08 02:28:06.638484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 234/485] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:28:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:28:06.649873 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e1b8326d-8ac5-418a-8415-4fa1ec09228c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:06.650582 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e1b8326d-8ac5-418a-8415-4fa1ec09228c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:06.708023 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e1b8326d-8ac5-418a-8415-4fa1ec09228c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:06.715180 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e1b8326d-8ac5-418a-8415-4fa1ec09228c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1245 microversion: 2.1 time: 0.069273 Aug 08 02:28:06.715772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 252/486] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:06 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:07.642114 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-57c299eb-45b8-4c0b-a66b-cde5fb432dda tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:07.642802 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-57c299eb-45b8-4c0b-a66b-cde5fb432dda tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:07.649604 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57c299eb-45b8-4c0b-a66b-cde5fb432dda tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:07.650079 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57c299eb-45b8-4c0b-a66b-cde5fb432dda tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:07.650539 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57c299eb-45b8-4c0b-a66b-cde5fb432dda tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:07.651223 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57c299eb-45b8-4c0b-a66b-cde5fb432dda tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:07.652658 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57c299eb-45b8-4c0b-a66b-cde5fb432dda tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:07.653088 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57c299eb-45b8-4c0b-a66b-cde5fb432dda tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:07.735542 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-52c0020b-4cc7-4b90-9553-37cadb0078a9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:07.736177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-52c0020b-4cc7-4b90-9553-37cadb0078a9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:07.742508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-52c0020b-4cc7-4b90-9553-37cadb0078a9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:07.742995 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-52c0020b-4cc7-4b90-9553-37cadb0078a9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:07.743428 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-52c0020b-4cc7-4b90-9553-37cadb0078a9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:07.744116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-52c0020b-4cc7-4b90-9553-37cadb0078a9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:07.744567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-52c0020b-4cc7-4b90-9553-37cadb0078a9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:07.744987 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-52c0020b-4cc7-4b90-9553-37cadb0078a9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:07.790052 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-57c299eb-45b8-4c0b-a66b-cde5fb432dda tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:07.797407 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-57c299eb-45b8-4c0b-a66b-cde5fb432dda tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.159657 Aug 08 02:28:07.797974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 235/487] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:07 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:07.806479 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-52c0020b-4cc7-4b90-9553-37cadb0078a9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:07.814565 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-52c0020b-4cc7-4b90-9553-37cadb0078a9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1249 microversion: 2.1 time: 0.082551 Aug 08 02:28:07.815121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 253/488] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:07 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:28:08.818934 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9766bb24-41f5-4028-96bf-f331da0a03eb tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:08.819555 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9766bb24-41f5-4028-96bf-f331da0a03eb tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:08.825902 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9766bb24-41f5-4028-96bf-f331da0a03eb tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:08.826486 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9766bb24-41f5-4028-96bf-f331da0a03eb tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:08.826922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9766bb24-41f5-4028-96bf-f331da0a03eb tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:08.827606 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9766bb24-41f5-4028-96bf-f331da0a03eb tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:08.828057 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9766bb24-41f5-4028-96bf-f331da0a03eb tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:08.828478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9766bb24-41f5-4028-96bf-f331da0a03eb tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:08.834230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5149f481-792c-4d67-8196-5e5e0c79c650 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:08.834886 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5149f481-792c-4d67-8196-5e5e0c79c650 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:08.841417 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5149f481-792c-4d67-8196-5e5e0c79c650 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:08.841896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5149f481-792c-4d67-8196-5e5e0c79c650 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:08.842488 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5149f481-792c-4d67-8196-5e5e0c79c650 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:08.843188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5149f481-792c-4d67-8196-5e5e0c79c650 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:08.843649 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5149f481-792c-4d67-8196-5e5e0c79c650 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:08.844078 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5149f481-792c-4d67-8196-5e5e0c79c650 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:08.914542 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5149f481-792c-4d67-8196-5e5e0c79c650 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:08.923072 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5149f481-792c-4d67-8196-5e5e0c79c650 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1249 microversion: 2.1 time: 0.092549 Aug 08 02:28:08.923833 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 254/489] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:08 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:28:08.964077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9766bb24-41f5-4028-96bf-f331da0a03eb tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:08.971949 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9766bb24-41f5-4028-96bf-f331da0a03eb tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.157189 Aug 08 02:28:08.972512 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 236/490] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:08 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:09.944390 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-341c0da4-d858-4f23-a972-19cf25c86a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:09.945001 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-341c0da4-d858-4f23-a972-19cf25c86a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:09.951420 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-341c0da4-d858-4f23-a972-19cf25c86a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:09.951996 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-341c0da4-d858-4f23-a972-19cf25c86a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:09.952651 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-341c0da4-d858-4f23-a972-19cf25c86a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:09.953392 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-341c0da4-d858-4f23-a972-19cf25c86a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:09.953849 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-341c0da4-d858-4f23-a972-19cf25c86a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:09.954297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-341c0da4-d858-4f23-a972-19cf25c86a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:09.972942 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:09.992486 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-99973597-ca73-48b9-a33a-3a6872312492 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:09.993312 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-99973597-ca73-48b9-a33a-3a6872312492 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:10.000151 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99973597-ca73-48b9-a33a-3a6872312492 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:10.000636 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99973597-ca73-48b9-a33a-3a6872312492 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:10.001070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99973597-ca73-48b9-a33a-3a6872312492 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:10.001771 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99973597-ca73-48b9-a33a-3a6872312492 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:10.002218 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99973597-ca73-48b9-a33a-3a6872312492 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:10.002667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99973597-ca73-48b9-a33a-3a6872312492 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:10.016884 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-341c0da4-d858-4f23-a972-19cf25c86a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:10.025870 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-341c0da4-d858-4f23-a972-19cf25c86a77 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1249 microversion: 2.1 time: 0.085263 Aug 08 02:28:10.026498 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 255/491] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:09 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:10.135780 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-99973597-ca73-48b9-a33a-3a6872312492 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:10.143109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-99973597-ca73-48b9-a33a-3a6872312492 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.154489 Aug 08 02:28:10.143666 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 237/492] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:09 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:11.048127 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-65445ab7-fda0-41f5-aaad-07f7d76f5cad tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:11.049234 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-65445ab7-fda0-41f5-aaad-07f7d76f5cad tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:11.056054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-65445ab7-fda0-41f5-aaad-07f7d76f5cad tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:11.056640 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-65445ab7-fda0-41f5-aaad-07f7d76f5cad tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:11.057095 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-65445ab7-fda0-41f5-aaad-07f7d76f5cad tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:11.058026 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-65445ab7-fda0-41f5-aaad-07f7d76f5cad tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:11.058545 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-65445ab7-fda0-41f5-aaad-07f7d76f5cad tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:11.059585 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-65445ab7-fda0-41f5-aaad-07f7d76f5cad tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:11.123275 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-65445ab7-fda0-41f5-aaad-07f7d76f5cad tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:11.131164 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-65445ab7-fda0-41f5-aaad-07f7d76f5cad tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1249 microversion: 2.1 time: 0.088105 Aug 08 02:28:11.131727 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 256/493] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:11 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:11.164483 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a22095a-02f9-4427-9abf-2ebc1f136042 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:11.165132 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a22095a-02f9-4427-9abf-2ebc1f136042 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:11.173460 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a22095a-02f9-4427-9abf-2ebc1f136042 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:11.174008 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a22095a-02f9-4427-9abf-2ebc1f136042 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:11.174926 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a22095a-02f9-4427-9abf-2ebc1f136042 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:11.180929 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a22095a-02f9-4427-9abf-2ebc1f136042 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:11.181762 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a22095a-02f9-4427-9abf-2ebc1f136042 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:11.182207 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a22095a-02f9-4427-9abf-2ebc1f136042 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:11.352819 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a22095a-02f9-4427-9abf-2ebc1f136042 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:11.361191 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a22095a-02f9-4427-9abf-2ebc1f136042 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.200881 Aug 08 02:28:11.362025 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 238/494] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:11 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:12.152959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8c14bc22-a204-4746-a18b-afe8bff57fa2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:12.154295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8c14bc22-a204-4746-a18b-afe8bff57fa2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:12.161728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8c14bc22-a204-4746-a18b-afe8bff57fa2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:12.162391 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8c14bc22-a204-4746-a18b-afe8bff57fa2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:12.163071 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8c14bc22-a204-4746-a18b-afe8bff57fa2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:12.163761 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8c14bc22-a204-4746-a18b-afe8bff57fa2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:12.164365 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8c14bc22-a204-4746-a18b-afe8bff57fa2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:12.164778 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8c14bc22-a204-4746-a18b-afe8bff57fa2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:12.237982 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8c14bc22-a204-4746-a18b-afe8bff57fa2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:12.246321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8c14bc22-a204-4746-a18b-afe8bff57fa2 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1297 microversion: 2.1 time: 0.097767 Aug 08 02:28:12.247201 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 257/495] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:12 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:12.383577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-02f76ecc-c159-4369-85fd-557184257d3d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:12.385128 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-02f76ecc-c159-4369-85fd-557184257d3d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:12.395390 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:12.400191 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-02f76ecc-c159-4369-85fd-557184257d3d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:12.400978 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-02f76ecc-c159-4369-85fd-557184257d3d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:12.401842 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-02f76ecc-c159-4369-85fd-557184257d3d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:12.405204 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-02f76ecc-c159-4369-85fd-557184257d3d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:12.405691 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-02f76ecc-c159-4369-85fd-557184257d3d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:12.406265 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-02f76ecc-c159-4369-85fd-557184257d3d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:12.667291 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-02f76ecc-c159-4369-85fd-557184257d3d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:12.675425 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-02f76ecc-c159-4369-85fd-557184257d3d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.296423 Aug 08 02:28:12.698610 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 239/496] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:12 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:13.269318 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0369b2cc-703e-43e8-ba41-f226ac991724 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:13.270004 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0369b2cc-703e-43e8-ba41-f226ac991724 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:13.279185 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0369b2cc-703e-43e8-ba41-f226ac991724 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:13.279743 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0369b2cc-703e-43e8-ba41-f226ac991724 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:13.280212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0369b2cc-703e-43e8-ba41-f226ac991724 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:13.280919 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0369b2cc-703e-43e8-ba41-f226ac991724 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:13.281406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0369b2cc-703e-43e8-ba41-f226ac991724 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:13.282482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0369b2cc-703e-43e8-ba41-f226ac991724 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:13.624782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0369b2cc-703e-43e8-ba41-f226ac991724 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:13.633199 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0369b2cc-703e-43e8-ba41-f226ac991724 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.368443 Aug 08 02:28:13.633912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 258/497] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:13 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:28:13.710727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b781e9a3-8325-46ee-b749-0a5a3f7b114d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:13.711336 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b781e9a3-8325-46ee-b749-0a5a3f7b114d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:13.719848 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b781e9a3-8325-46ee-b749-0a5a3f7b114d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:13.720480 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b781e9a3-8325-46ee-b749-0a5a3f7b114d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:13.720960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b781e9a3-8325-46ee-b749-0a5a3f7b114d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:13.721931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b781e9a3-8325-46ee-b749-0a5a3f7b114d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:13.722493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b781e9a3-8325-46ee-b749-0a5a3f7b114d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:13.723146 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b781e9a3-8325-46ee-b749-0a5a3f7b114d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:13.886828 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b781e9a3-8325-46ee-b749-0a5a3f7b114d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:13.896286 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b781e9a3-8325-46ee-b749-0a5a3f7b114d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.189239 Aug 08 02:28:13.897925 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 240/498] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:13 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:14.201335 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-dc4211f1-d8f2-4d58-88fd-3867168d97c2 req-045e31d6-3e8c-4243-9bf5-0ca72c1e9c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ea1a9c-fd55-4d21-909a-235e4422e6d6", "name": "network-vif-plugged", "status": "completed", "tag": "eac6eba0-4fcb-45b9-8708-de73198d3388"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:28:14.224686 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-dc4211f1-d8f2-4d58-88fd-3867168d97c2 req-045e31d6-3e8c-4243-9bf5-0ca72c1e9c83 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:14.225672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-dc4211f1-d8f2-4d58-88fd-3867168d97c2 req-045e31d6-3e8c-4243-9bf5-0ca72c1e9c83 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:14.230566 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-dc4211f1-d8f2-4d58-88fd-3867168d97c2 req-045e31d6-3e8c-4243-9bf5-0ca72c1e9c83 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:14.264706 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-dc4211f1-d8f2-4d58-88fd-3867168d97c2 req-045e31d6-3e8c-4243-9bf5-0ca72c1e9c83 service nova] Creating event network-vif-plugged:eac6eba0-4fcb-45b9-8708-de73198d3388 for instance f1ea1a9c-fd55-4d21-909a-235e4422e6d6 on hv-cinder-73306 Aug 08 02:28:14.272025 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-dc4211f1-d8f2-4d58-88fd-3867168d97c2 req-045e31d6-3e8c-4243-9bf5-0ca72c1e9c83 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076449 Aug 08 02:28:14.279969 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 259/499] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:28:14.295564 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-d6e0bc5f-bc9e-4552-bf09-8349585c5ff6 req-f5db22d4-f4fc-4910-9fb3-bd89402d4a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62da7e2f-df45-473c-bdee-84d29c6ccfcf", "tag": "5d4b749d-627c-40da-b320-bd2ec4551c36"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:28:14.310196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d6e0bc5f-bc9e-4552-bf09-8349585c5ff6 req-f5db22d4-f4fc-4910-9fb3-bd89402d4a8e service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:14.311577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d6e0bc5f-bc9e-4552-bf09-8349585c5ff6 req-f5db22d4-f4fc-4910-9fb3-bd89402d4a8e service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:14.312617 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d6e0bc5f-bc9e-4552-bf09-8349585c5ff6 req-f5db22d4-f4fc-4910-9fb3-bd89402d4a8e service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:14.331878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-d6e0bc5f-bc9e-4552-bf09-8349585c5ff6 req-f5db22d4-f4fc-4910-9fb3-bd89402d4a8e service nova] Creating event network-changed:5d4b749d-627c-40da-b320-bd2ec4551c36 for instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf on hv-cinder-73306 Aug 08 02:28:14.339089 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-d6e0bc5f-bc9e-4552-bf09-8349585c5ff6 req-f5db22d4-f4fc-4910-9fb3-bd89402d4a8e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049825 Aug 08 02:28:14.340378 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 241/500] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:28:14.659174 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-025dd26c-b850-4cb7-ab3b-b9640ef9128b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:14.661407 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-025dd26c-b850-4cb7-ab3b-b9640ef9128b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:14.694211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:14.696928 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-025dd26c-b850-4cb7-ab3b-b9640ef9128b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:14.697704 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-025dd26c-b850-4cb7-ab3b-b9640ef9128b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:14.698210 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-025dd26c-b850-4cb7-ab3b-b9640ef9128b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:14.700001 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-025dd26c-b850-4cb7-ab3b-b9640ef9128b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:14.700591 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-025dd26c-b850-4cb7-ab3b-b9640ef9128b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:14.701082 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-025dd26c-b850-4cb7-ab3b-b9640ef9128b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:14.888154 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-025dd26c-b850-4cb7-ab3b-b9640ef9128b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:14.896708 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-025dd26c-b850-4cb7-ab3b-b9640ef9128b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.242224 Aug 08 02:28:14.897215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 260/501] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:14 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:14.921685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-98d343ee-a6dc-4221-a765-bca983725f49 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:14.923103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-98d343ee-a6dc-4221-a765-bca983725f49 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:14.929793 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98d343ee-a6dc-4221-a765-bca983725f49 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:14.930602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98d343ee-a6dc-4221-a765-bca983725f49 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:14.931220 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98d343ee-a6dc-4221-a765-bca983725f49 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:14.932150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98d343ee-a6dc-4221-a765-bca983725f49 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:14.932777 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98d343ee-a6dc-4221-a765-bca983725f49 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:14.933378 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-98d343ee-a6dc-4221-a765-bca983725f49 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:15.073263 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-98d343ee-a6dc-4221-a765-bca983725f49 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:15.085679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-98d343ee-a6dc-4221-a765-bca983725f49 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.169320 Aug 08 02:28:15.098907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 242/502] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:14 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:15.916990 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5c675e5c-6cd2-44f9-b946-472fe1028eb8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:15.917664 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5c675e5c-6cd2-44f9-b946-472fe1028eb8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:15.924896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5c675e5c-6cd2-44f9-b946-472fe1028eb8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:15.925457 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5c675e5c-6cd2-44f9-b946-472fe1028eb8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:15.926156 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5c675e5c-6cd2-44f9-b946-472fe1028eb8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:15.926941 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5c675e5c-6cd2-44f9-b946-472fe1028eb8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:15.927387 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5c675e5c-6cd2-44f9-b946-472fe1028eb8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:15.927794 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5c675e5c-6cd2-44f9-b946-472fe1028eb8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:16.065746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5c675e5c-6cd2-44f9-b946-472fe1028eb8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:16.073477 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5c675e5c-6cd2-44f9-b946-472fe1028eb8 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.160403 Aug 08 02:28:16.074286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 261/503] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:15 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:16.108131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6b50f807-b836-487f-b77e-797e0b12cb61 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:16.108962 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6b50f807-b836-487f-b77e-797e0b12cb61 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:16.115227 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b50f807-b836-487f-b77e-797e0b12cb61 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:16.115708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b50f807-b836-487f-b77e-797e0b12cb61 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:16.116139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b50f807-b836-487f-b77e-797e0b12cb61 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:16.117011 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b50f807-b836-487f-b77e-797e0b12cb61 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:16.117470 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b50f807-b836-487f-b77e-797e0b12cb61 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:16.117895 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b50f807-b836-487f-b77e-797e0b12cb61 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:16.253955 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6b50f807-b836-487f-b77e-797e0b12cb61 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:16.258817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:16.266727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6b50f807-b836-487f-b77e-797e0b12cb61 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.163302 Aug 08 02:28:16.280258 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 243/504] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:16 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:17.097314 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-095e7798-ec20-4a78-991e-674beeec5a07 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:17.097890 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-095e7798-ec20-4a78-991e-674beeec5a07 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:17.099820 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:17.105095 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-095e7798-ec20-4a78-991e-674beeec5a07 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:17.106484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-095e7798-ec20-4a78-991e-674beeec5a07 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:17.106934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-095e7798-ec20-4a78-991e-674beeec5a07 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:17.107634 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-095e7798-ec20-4a78-991e-674beeec5a07 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:17.108259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-095e7798-ec20-4a78-991e-674beeec5a07 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:17.108680 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-095e7798-ec20-4a78-991e-674beeec5a07 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:17.257787 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-095e7798-ec20-4a78-991e-674beeec5a07 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:17.272656 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-095e7798-ec20-4a78-991e-674beeec5a07 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.179047 Aug 08 02:28:17.274292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 262/505] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:17 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:17.289772 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-930f0149-fe15-485e-83cf-8fe9cd202f3e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:17.291140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-930f0149-fe15-485e-83cf-8fe9cd202f3e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:17.294048 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:17.295256 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=10 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:28:17.301059 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-930f0149-fe15-485e-83cf-8fe9cd202f3e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:17.301750 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-930f0149-fe15-485e-83cf-8fe9cd202f3e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:17.302209 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-930f0149-fe15-485e-83cf-8fe9cd202f3e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:17.302934 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-930f0149-fe15-485e-83cf-8fe9cd202f3e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:17.303550 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-930f0149-fe15-485e-83cf-8fe9cd202f3e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:17.303972 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-930f0149-fe15-485e-83cf-8fe9cd202f3e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:17.521618 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-930f0149-fe15-485e-83cf-8fe9cd202f3e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:17.532656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-930f0149-fe15-485e-83cf-8fe9cd202f3e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1319 microversion: 2.1 time: 0.248767 Aug 08 02:28:17.533240 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 244/506] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:17 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:18.293737 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-32f5ff8e-294e-4ea8-ae8f-186c0d3a3468 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:18.294542 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-32f5ff8e-294e-4ea8-ae8f-186c0d3a3468 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:18.300807 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-32f5ff8e-294e-4ea8-ae8f-186c0d3a3468 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:18.301330 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-32f5ff8e-294e-4ea8-ae8f-186c0d3a3468 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:18.301946 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-32f5ff8e-294e-4ea8-ae8f-186c0d3a3468 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:18.302893 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-32f5ff8e-294e-4ea8-ae8f-186c0d3a3468 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:18.303382 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-32f5ff8e-294e-4ea8-ae8f-186c0d3a3468 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:18.303795 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-32f5ff8e-294e-4ea8-ae8f-186c0d3a3468 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:18.457985 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-32f5ff8e-294e-4ea8-ae8f-186c0d3a3468 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:18.466658 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-32f5ff8e-294e-4ea8-ae8f-186c0d3a3468 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.177505 Aug 08 02:28:18.467268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 263/507] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:18 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:18.565074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bf142153-f0dc-48f0-857c-2ce52abb82f8 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:18.565610 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bf142153-f0dc-48f0-857c-2ce52abb82f8 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:18.573197 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf142153-f0dc-48f0-857c-2ce52abb82f8 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:18.573763 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf142153-f0dc-48f0-857c-2ce52abb82f8 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:18.574476 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf142153-f0dc-48f0-857c-2ce52abb82f8 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:18.575350 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf142153-f0dc-48f0-857c-2ce52abb82f8 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:18.575856 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf142153-f0dc-48f0-857c-2ce52abb82f8 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:18.576394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf142153-f0dc-48f0-857c-2ce52abb82f8 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:18.733064 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bf142153-f0dc-48f0-857c-2ce52abb82f8 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:18.742515 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bf142153-f0dc-48f0-857c-2ce52abb82f8 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1508 microversion: 2.1 time: 0.181787 Aug 08 02:28:18.743430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 245/508] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:18 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:19.488331 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-16b5ccde-0fc9-4779-bf4e-49a3f43e5a29 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:19.489110 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-16b5ccde-0fc9-4779-bf4e-49a3f43e5a29 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:19.495307 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-16b5ccde-0fc9-4779-bf4e-49a3f43e5a29 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:19.495863 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-16b5ccde-0fc9-4779-bf4e-49a3f43e5a29 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:19.496371 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-16b5ccde-0fc9-4779-bf4e-49a3f43e5a29 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:19.497157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-16b5ccde-0fc9-4779-bf4e-49a3f43e5a29 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:19.497615 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-16b5ccde-0fc9-4779-bf4e-49a3f43e5a29 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:19.498039 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-16b5ccde-0fc9-4779-bf4e-49a3f43e5a29 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:19.646372 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-16b5ccde-0fc9-4779-bf4e-49a3f43e5a29 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:19.655349 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-16b5ccde-0fc9-4779-bf4e-49a3f43e5a29 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.171075 Aug 08 02:28:19.656028 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 264/509] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:19 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:28:20.677310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ca340606-a774-4090-a0c1-a8a5d4fd8309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:20.678081 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ca340606-a774-4090-a0c1-a8a5d4fd8309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:20.687531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca340606-a774-4090-a0c1-a8a5d4fd8309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:20.688233 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca340606-a774-4090-a0c1-a8a5d4fd8309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:20.688518 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca340606-a774-4090-a0c1-a8a5d4fd8309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:20.689300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca340606-a774-4090-a0c1-a8a5d4fd8309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:20.690080 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca340606-a774-4090-a0c1-a8a5d4fd8309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:20.690584 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca340606-a774-4090-a0c1-a8a5d4fd8309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:20.849805 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ca340606-a774-4090-a0c1-a8a5d4fd8309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:20.860079 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ca340606-a774-4090-a0c1-a8a5d4fd8309 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.187034 Aug 08 02:28:20.860870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 246/510] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:20 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:21.881246 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-eace5ed0-457a-41ef-8189-d7027d203393 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:21.882892 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-eace5ed0-457a-41ef-8189-d7027d203393 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:21.889554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-eace5ed0-457a-41ef-8189-d7027d203393 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:21.890414 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-eace5ed0-457a-41ef-8189-d7027d203393 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:21.891086 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-eace5ed0-457a-41ef-8189-d7027d203393 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:21.892047 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-eace5ed0-457a-41ef-8189-d7027d203393 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:21.892991 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-eace5ed0-457a-41ef-8189-d7027d203393 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:21.893637 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-eace5ed0-457a-41ef-8189-d7027d203393 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:22.075406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-eace5ed0-457a-41ef-8189-d7027d203393 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:22.083249 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-eace5ed0-457a-41ef-8189-d7027d203393 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.206121 Aug 08 02:28:22.083854 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 265/511] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:21 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:28:23.104167 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-10cbdb3d-659f-4c9a-b0ab-d83f314311b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:23.104785 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-10cbdb3d-659f-4c9a-b0ab-d83f314311b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:23.125914 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10cbdb3d-659f-4c9a-b0ab-d83f314311b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:23.126439 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10cbdb3d-659f-4c9a-b0ab-d83f314311b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:23.127151 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10cbdb3d-659f-4c9a-b0ab-d83f314311b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:23.128095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10cbdb3d-659f-4c9a-b0ab-d83f314311b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:23.128574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10cbdb3d-659f-4c9a-b0ab-d83f314311b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:23.128999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10cbdb3d-659f-4c9a-b0ab-d83f314311b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:23.284543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-10cbdb3d-659f-4c9a-b0ab-d83f314311b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:23.292401 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-10cbdb3d-659f-4c9a-b0ab-d83f314311b7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.191951 Aug 08 02:28:23.293561 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 247/512] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:23 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:24.312948 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-668d52d9-4333-4537-990a-3a37ff02bcc0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:24.313759 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-668d52d9-4333-4537-990a-3a37ff02bcc0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:24.320275 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-668d52d9-4333-4537-990a-3a37ff02bcc0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:24.320753 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-668d52d9-4333-4537-990a-3a37ff02bcc0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:24.321186 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-668d52d9-4333-4537-990a-3a37ff02bcc0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:24.321867 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-668d52d9-4333-4537-990a-3a37ff02bcc0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:24.322352 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-668d52d9-4333-4537-990a-3a37ff02bcc0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:24.322773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-668d52d9-4333-4537-990a-3a37ff02bcc0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:24.465592 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-668d52d9-4333-4537-990a-3a37ff02bcc0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:24.474650 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-668d52d9-4333-4537-990a-3a37ff02bcc0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.165504 Aug 08 02:28:24.488629 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 266/513] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:24 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:25.496340 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-10c7c0c9-eda1-4229-af4c-ce04b87d833d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:25.497678 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-10c7c0c9-eda1-4229-af4c-ce04b87d833d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:25.504695 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10c7c0c9-eda1-4229-af4c-ce04b87d833d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:25.505385 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10c7c0c9-eda1-4229-af4c-ce04b87d833d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:25.506216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10c7c0c9-eda1-4229-af4c-ce04b87d833d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:25.507124 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10c7c0c9-eda1-4229-af4c-ce04b87d833d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:25.507888 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10c7c0c9-eda1-4229-af4c-ce04b87d833d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:25.508767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10c7c0c9-eda1-4229-af4c-ce04b87d833d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:25.659996 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-10c7c0c9-eda1-4229-af4c-ce04b87d833d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:25.670453 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-10c7c0c9-eda1-4229-af4c-ce04b87d833d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.177395 Aug 08 02:28:25.684232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 248/514] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:25 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:26.690986 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e146bb3d-630a-464f-9796-9275bf45dafb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:26.691900 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e146bb3d-630a-464f-9796-9275bf45dafb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:26.698744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e146bb3d-630a-464f-9796-9275bf45dafb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:26.699826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e146bb3d-630a-464f-9796-9275bf45dafb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:26.700566 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e146bb3d-630a-464f-9796-9275bf45dafb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:26.701482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e146bb3d-630a-464f-9796-9275bf45dafb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:26.702156 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e146bb3d-630a-464f-9796-9275bf45dafb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:26.702883 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e146bb3d-630a-464f-9796-9275bf45dafb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:26.877353 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e146bb3d-630a-464f-9796-9275bf45dafb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:26.884899 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e146bb3d-630a-464f-9796-9275bf45dafb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.198387 Aug 08 02:28:26.885466 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 267/515] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:26 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:27.921187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5b31f33f-1100-48ba-b25d-4dc88e11c69d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:27.921966 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5b31f33f-1100-48ba-b25d-4dc88e11c69d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:27.929523 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b31f33f-1100-48ba-b25d-4dc88e11c69d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:27.929953 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b31f33f-1100-48ba-b25d-4dc88e11c69d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:27.930418 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b31f33f-1100-48ba-b25d-4dc88e11c69d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:27.931151 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b31f33f-1100-48ba-b25d-4dc88e11c69d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:27.931596 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b31f33f-1100-48ba-b25d-4dc88e11c69d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:27.932025 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b31f33f-1100-48ba-b25d-4dc88e11c69d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:28.118744 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5b31f33f-1100-48ba-b25d-4dc88e11c69d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:28.126056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5b31f33f-1100-48ba-b25d-4dc88e11c69d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.224863 Aug 08 02:28:28.126675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 249/516] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:27 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:29.147011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c88bd1d2-a4cf-44e6-94e6-f71f6c8b6211 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:29.147806 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c88bd1d2-a4cf-44e6-94e6-f71f6c8b6211 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:29.154397 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c88bd1d2-a4cf-44e6-94e6-f71f6c8b6211 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:29.155079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c88bd1d2-a4cf-44e6-94e6-f71f6c8b6211 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:29.155501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c88bd1d2-a4cf-44e6-94e6-f71f6c8b6211 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:29.156355 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c88bd1d2-a4cf-44e6-94e6-f71f6c8b6211 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:29.156953 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c88bd1d2-a4cf-44e6-94e6-f71f6c8b6211 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:29.157528 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c88bd1d2-a4cf-44e6-94e6-f71f6c8b6211 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:29.310966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c88bd1d2-a4cf-44e6-94e6-f71f6c8b6211 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:29.319104 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c88bd1d2-a4cf-44e6-94e6-f71f6c8b6211 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.176025 Aug 08 02:28:29.319803 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 268/517] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:29 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:30.340326 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eca10b3d-baf9-4764-af05-ca7232896eb5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:30.341701 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eca10b3d-baf9-4764-af05-ca7232896eb5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:30.349283 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eca10b3d-baf9-4764-af05-ca7232896eb5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:30.349765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eca10b3d-baf9-4764-af05-ca7232896eb5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:30.350467 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eca10b3d-baf9-4764-af05-ca7232896eb5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:30.351329 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eca10b3d-baf9-4764-af05-ca7232896eb5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:30.351785 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eca10b3d-baf9-4764-af05-ca7232896eb5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:30.352266 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eca10b3d-baf9-4764-af05-ca7232896eb5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:30.500335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eca10b3d-baf9-4764-af05-ca7232896eb5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:30.508089 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eca10b3d-baf9-4764-af05-ca7232896eb5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.171856 Aug 08 02:28:30.508661 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 250/518] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:30 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:31.531340 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-052a76c9-324e-4ba4-9c01-68009af08175 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:31.532710 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-052a76c9-324e-4ba4-9c01-68009af08175 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:31.539122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-052a76c9-324e-4ba4-9c01-68009af08175 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:31.539666 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-052a76c9-324e-4ba4-9c01-68009af08175 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:31.540163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-052a76c9-324e-4ba4-9c01-68009af08175 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:31.540911 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-052a76c9-324e-4ba4-9c01-68009af08175 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:31.541440 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-052a76c9-324e-4ba4-9c01-68009af08175 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:31.542084 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-052a76c9-324e-4ba4-9c01-68009af08175 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:31.682151 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-052a76c9-324e-4ba4-9c01-68009af08175 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:31.690919 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-052a76c9-324e-4ba4-9c01-68009af08175 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.164420 Aug 08 02:28:31.692228 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 269/519] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:31 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:32.569947 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-8b3503ad-9cc3-4dc7-b57f-b3fe9c84712d req-209c31b7-0efb-4e18-8ba4-332f4a875abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62da7e2f-df45-473c-bdee-84d29c6ccfcf", "name": "network-vif-plugged", "status": "completed", "tag": "5d4b749d-627c-40da-b320-bd2ec4551c36"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:28:32.586801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-8b3503ad-9cc3-4dc7-b57f-b3fe9c84712d req-209c31b7-0efb-4e18-8ba4-332f4a875abe service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:32.587733 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-8b3503ad-9cc3-4dc7-b57f-b3fe9c84712d req-209c31b7-0efb-4e18-8ba4-332f4a875abe service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:32.588301 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-8b3503ad-9cc3-4dc7-b57f-b3fe9c84712d req-209c31b7-0efb-4e18-8ba4-332f4a875abe service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:32.600687 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-8b3503ad-9cc3-4dc7-b57f-b3fe9c84712d req-209c31b7-0efb-4e18-8ba4-332f4a875abe service nova] Creating event network-vif-plugged:5d4b749d-627c-40da-b320-bd2ec4551c36 for instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf on hv-cinder-73306 Aug 08 02:28:32.607512 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-8b3503ad-9cc3-4dc7-b57f-b3fe9c84712d req-209c31b7-0efb-4e18-8ba4-332f4a875abe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041455 Aug 08 02:28:32.608978 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 251/520] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:28:32.720470 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-43a14724-e02c-4918-a699-3e84663d04dc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:32.724122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-43a14724-e02c-4918-a699-3e84663d04dc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:32.734464 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-43a14724-e02c-4918-a699-3e84663d04dc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:32.735864 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-43a14724-e02c-4918-a699-3e84663d04dc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:32.736709 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-43a14724-e02c-4918-a699-3e84663d04dc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:32.737982 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-43a14724-e02c-4918-a699-3e84663d04dc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:32.738815 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-43a14724-e02c-4918-a699-3e84663d04dc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:32.739557 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-43a14724-e02c-4918-a699-3e84663d04dc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:32.954468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-43a14724-e02c-4918-a699-3e84663d04dc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:32.963666 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-43a14724-e02c-4918-a699-3e84663d04dc tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.254075 Aug 08 02:28:32.964273 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 270/521] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:32 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:33.985722 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-43ddfcfc-bd36-4d03-8860-495ea407fdd6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:33.986364 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-43ddfcfc-bd36-4d03-8860-495ea407fdd6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:33.992421 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-43ddfcfc-bd36-4d03-8860-495ea407fdd6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:33.992899 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-43ddfcfc-bd36-4d03-8860-495ea407fdd6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:33.993328 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-43ddfcfc-bd36-4d03-8860-495ea407fdd6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:33.994007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-43ddfcfc-bd36-4d03-8860-495ea407fdd6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:33.994481 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-43ddfcfc-bd36-4d03-8860-495ea407fdd6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:33.995021 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-43ddfcfc-bd36-4d03-8860-495ea407fdd6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:34.126467 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-43ddfcfc-bd36-4d03-8860-495ea407fdd6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:34.133816 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-43ddfcfc-bd36-4d03-8860-495ea407fdd6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.152839 Aug 08 02:28:34.134395 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 252/522] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:33 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:35.156677 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-56451bb8-c899-4f19-9b56-052e84f22ae9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:35.157299 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-56451bb8-c899-4f19-9b56-052e84f22ae9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:35.164124 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56451bb8-c899-4f19-9b56-052e84f22ae9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:35.164675 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56451bb8-c899-4f19-9b56-052e84f22ae9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:35.165130 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56451bb8-c899-4f19-9b56-052e84f22ae9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:35.165817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56451bb8-c899-4f19-9b56-052e84f22ae9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:35.166278 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56451bb8-c899-4f19-9b56-052e84f22ae9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:35.166697 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-56451bb8-c899-4f19-9b56-052e84f22ae9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:35.344412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-56451bb8-c899-4f19-9b56-052e84f22ae9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:35.351939 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-56451bb8-c899-4f19-9b56-052e84f22ae9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1371 microversion: 2.1 time: 0.200175 Aug 08 02:28:35.353159 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 271/523] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:35 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:36.372716 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8c745dd1-ad74-4443-86d4-f0aada4e0a34 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:36.373328 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8c745dd1-ad74-4443-86d4-f0aada4e0a34 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:36.380132 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c745dd1-ad74-4443-86d4-f0aada4e0a34 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:36.380810 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c745dd1-ad74-4443-86d4-f0aada4e0a34 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:36.381261 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c745dd1-ad74-4443-86d4-f0aada4e0a34 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:36.382082 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c745dd1-ad74-4443-86d4-f0aada4e0a34 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:36.382924 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c745dd1-ad74-4443-86d4-f0aada4e0a34 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:36.383265 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c745dd1-ad74-4443-86d4-f0aada4e0a34 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:36.556578 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8c745dd1-ad74-4443-86d4-f0aada4e0a34 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:28:36.564109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8c745dd1-ad74-4443-86d4-f0aada4e0a34 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1565 microversion: 2.1 time: 0.195111 Aug 08 02:28:36.564867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 253/524] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:28:36 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1565 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:28:36.587760 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-850fdc8a-f402-4605-803d-4dd8c8620f00 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:28:36.588316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-850fdc8a-f402-4605-803d-4dd8c8620f00 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:28:36.595223 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-850fdc8a-f402-4605-803d-4dd8c8620f00 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:36.595698 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-850fdc8a-f402-4605-803d-4dd8c8620f00 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:36.596117 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-850fdc8a-f402-4605-803d-4dd8c8620f00 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:36.596798 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-850fdc8a-f402-4605-803d-4dd8c8620f00 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:36.597238 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-850fdc8a-f402-4605-803d-4dd8c8620f00 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:36.597653 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-850fdc8a-f402-4605-803d-4dd8c8620f00 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:36.677495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-850fdc8a-f402-4605-803d-4dd8c8620f00 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093558 Aug 08 02:28:36.678131 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 272/525] 10.222.0.39 () {58 vars in 1275 bytes} [Mon Aug 8 02:28:36 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:28:37.700482 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-fb0b751d-3dda-4108-ac63-fda3ddfa8222 req-60a51115-2f66-4b77-b9fd-d61c7dffb0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62da7e2f-df45-473c-bdee-84d29c6ccfcf", "tag": "5d4b749d-627c-40da-b320-bd2ec4551c36"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:28:37.710722 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-fb0b751d-3dda-4108-ac63-fda3ddfa8222 req-60a51115-2f66-4b77-b9fd-d61c7dffb0d2 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:28:37.711400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-fb0b751d-3dda-4108-ac63-fda3ddfa8222 req-60a51115-2f66-4b77-b9fd-d61c7dffb0d2 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:28:37.712019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-fb0b751d-3dda-4108-ac63-fda3ddfa8222 req-60a51115-2f66-4b77-b9fd-d61c7dffb0d2 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:28:37.724760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-fb0b751d-3dda-4108-ac63-fda3ddfa8222 req-60a51115-2f66-4b77-b9fd-d61c7dffb0d2 service nova] Creating event network-changed:5d4b749d-627c-40da-b320-bd2ec4551c36 for instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf on hv-cinder-73306 Aug 08 02:28:37.730221 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-fb0b751d-3dda-4108-ac63-fda3ddfa8222 req-60a51115-2f66-4b77-b9fd-d61c7dffb0d2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033413 Aug 08 02:28:37.731456 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 254/526] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:28:56.694102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:28:56.694634 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Mon Aug 8 02:28:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:29:02.911223 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=25 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:02.911965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=98 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:02.916259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-bd5f7e7e-1851-4cd0-b263-62451263c682 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:02.916771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-bd5f7e7e-1851-4cd0-b263-62451263c682 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:02.923910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bd5f7e7e-1851-4cd0-b263-62451263c682 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:02.924389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bd5f7e7e-1851-4cd0-b263-62451263c682 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:02.924814 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bd5f7e7e-1851-4cd0-b263-62451263c682 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:02.925485 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bd5f7e7e-1851-4cd0-b263-62451263c682 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:02.925926 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bd5f7e7e-1851-4cd0-b263-62451263c682 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:02.926379 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bd5f7e7e-1851-4cd0-b263-62451263c682 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:02.949431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-bd5f7e7e-1851-4cd0-b263-62451263c682 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/ips" status: 200 len: 150 microversion: 2.1 time: 0.039108 Aug 08 02:29:02.949970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 273/527] 10.222.0.39 () {58 vars in 1248 bytes} [Mon Aug 8 02:29:02 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:29:04.681748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=31 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:04.682531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=58 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:04.687616 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ed394daf-9dc3-493c-be83-9f23bfd646bc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:04.688201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ed394daf-9dc3-493c-be83-9f23bfd646bc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:04.695393 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed394daf-9dc3-493c-be83-9f23bfd646bc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:04.695875 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed394daf-9dc3-493c-be83-9f23bfd646bc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:04.696355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed394daf-9dc3-493c-be83-9f23bfd646bc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:04.696993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed394daf-9dc3-493c-be83-9f23bfd646bc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:04.697442 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed394daf-9dc3-493c-be83-9f23bfd646bc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:04.697869 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed394daf-9dc3-493c-be83-9f23bfd646bc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:04.720973 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ed394daf-9dc3-493c-be83-9f23bfd646bc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/ips" status: 200 len: 145 microversion: 2.1 time: 0.041438 Aug 08 02:29:04.721537 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 255/528] 10.222.0.39 () {58 vars in 1248 bytes} [Mon Aug 8 02:29:04 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:29:07.011717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-76eb7a49-44ed-4ca8-9cb1-79ab9dc9eec7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d7e0bb5-35e2-4d49-b00c-3566a862319e", "device": "/dev/sdb"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:29:07.015035 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-76eb7a49-44ed-4ca8-9cb1-79ab9dc9eec7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:07.021062 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-76eb7a49-44ed-4ca8-9cb1-79ab9dc9eec7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:07.021546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-76eb7a49-44ed-4ca8-9cb1-79ab9dc9eec7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:07.021980 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-76eb7a49-44ed-4ca8-9cb1-79ab9dc9eec7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:07.022698 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-76eb7a49-44ed-4ca8-9cb1-79ab9dc9eec7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:07.023152 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-76eb7a49-44ed-4ca8-9cb1-79ab9dc9eec7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:07.023573 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-76eb7a49-44ed-4ca8-9cb1-79ab9dc9eec7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:07.304177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-76eb7a49-44ed-4ca8-9cb1-79ab9dc9eec7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "POST /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296140 Aug 08 02:29:07.304816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 274/529] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:29:07 2022] POST /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:29:09.549390 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-15b6d40d-544b-4977-8331-e86ffddc5c20 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ded2a2b5-8201-4fc9-9bda-e11b100f7992"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:29:09.551723 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-15b6d40d-544b-4977-8331-e86ffddc5c20 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:09.557960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15b6d40d-544b-4977-8331-e86ffddc5c20 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:09.558485 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15b6d40d-544b-4977-8331-e86ffddc5c20 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:09.558920 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15b6d40d-544b-4977-8331-e86ffddc5c20 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:09.559607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15b6d40d-544b-4977-8331-e86ffddc5c20 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:09.560544 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15b6d40d-544b-4977-8331-e86ffddc5c20 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:09.560983 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15b6d40d-544b-4977-8331-e86ffddc5c20 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:09.822209 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-15b6d40d-544b-4977-8331-e86ffddc5c20 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276386 Aug 08 02:29:09.822846 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 256/530] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:29:09 2022] POST /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:29:10.238768 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3c573777-a46e-4cfa-9a23-bb184c2daf51 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04cb6773-0379-43cb-812f-c147c4e454bb"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:29:10.241983 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3c573777-a46e-4cfa-9a23-bb184c2daf51 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:10.249396 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c573777-a46e-4cfa-9a23-bb184c2daf51 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:10.249876 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c573777-a46e-4cfa-9a23-bb184c2daf51 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:10.250326 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c573777-a46e-4cfa-9a23-bb184c2daf51 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:10.251171 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c573777-a46e-4cfa-9a23-bb184c2daf51 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:10.251848 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c573777-a46e-4cfa-9a23-bb184c2daf51 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:10.252173 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c573777-a46e-4cfa-9a23-bb184c2daf51 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:10.523679 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3c573777-a46e-4cfa-9a23-bb184c2daf51 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "POST /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289686 Aug 08 02:29:10.524468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 275/531] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:29:10 2022] POST /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:29:26.981150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0bd521cd-0247-4c68-9c30-08cb33dcf757 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: .version_select at 0x7f3295c5c0d0>, body: {"keypair": {"name": "tempest-keypair-2035145644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfwN7ile+CoPOTZc94eBzvdX/pTPxWyo9+vXnw3NqlSvJ9Tsi31beiJFvJ+CaOK1JYp+t/NvX6yPadKL5wDU/4ONcxfSlPM0v3pkyizLWGcxLOUc1HZI901VrKWh/JHTA=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:29:26.987746 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:26.988567 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:27.002211 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-0bd521cd-0247-4c68-9c30-08cb33dcf757 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:29:27.006118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-0bd521cd-0247-4c68-9c30-08cb33dcf757 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for user 43dd72b161f8442285dea411741d66b3 and project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:29:27.027045 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0bd521cd-0247-4c68-9c30-08cb33dcf757 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050108 Aug 08 02:29:27.027665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 257/532] 10.222.0.39 () {60 vars in 1159 bytes} [Mon Aug 8 02:29:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:29:28.252700 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1753998197", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a62e92c-7187-4f0e-842d-c113cd8a0af1"}], "security_groups": [{"name": "tempest-securitygroup--1281345613"}], "key_name": "tempest-keypair-2035145644", "user_data": "}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:29:28.261216 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=6 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:28.261903 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:28.356884 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.network.neutron [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] validate_networks() for [('2a62e92c-7187-4f0e-842d-c113cd8a0af1', None, None, None, None, None)] {{(pid=117640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:29:28.721358 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Flavor limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:29:28.721784 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Image limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:29:28.722273 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Flavor pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:29:28.722687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Image pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:29:28.723098 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:29:28.731876 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:28.732351 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:28.732785 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:28.733505 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:28.733959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:28.734423 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:28.751267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:29:28.755226 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for user 43dd72b161f8442285dea411741d66b3 and project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:29:28.766673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Going to run 1 instances... {{(pid=117640) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:29:28.768988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:29:28.815538 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d7f5a550-ded4-4565-9714-32dcf868d1b9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568093 Aug 08 02:29:28.816165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 276/533] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:29:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:29:28.828079 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4e94cbb3-7e07-43e7-be08-18b7b645324d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:28.829504 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4e94cbb3-7e07-43e7-be08-18b7b645324d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:28.889352 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4e94cbb3-7e07-43e7-be08-18b7b645324d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:28.897076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4e94cbb3-7e07-43e7-be08-18b7b645324d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1242 microversion: 2.1 time: 0.073770 Aug 08 02:29:28.897712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 258/534] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:28 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:29.918366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2b981632-f962-421f-902f-053a95cee120 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:29.918975 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2b981632-f962-421f-902f-053a95cee120 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:29.925834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b981632-f962-421f-902f-053a95cee120 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:29.926327 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b981632-f962-421f-902f-053a95cee120 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:29.926755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b981632-f962-421f-902f-053a95cee120 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:29.927431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b981632-f962-421f-902f-053a95cee120 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:29.927877 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b981632-f962-421f-902f-053a95cee120 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:29.928289 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b981632-f962-421f-902f-053a95cee120 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:29.999687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2b981632-f962-421f-902f-053a95cee120 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:30.007110 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2b981632-f962-421f-902f-053a95cee120 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1246 microversion: 2.1 time: 0.093092 Aug 08 02:29:30.007668 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 277/535] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:29 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:31.027202 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0d9e3c09-f2d8-495a-8411-b7c43a8481d6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:31.027811 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0d9e3c09-f2d8-495a-8411-b7c43a8481d6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:31.034433 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d9e3c09-f2d8-495a-8411-b7c43a8481d6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:31.034909 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d9e3c09-f2d8-495a-8411-b7c43a8481d6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:31.035335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d9e3c09-f2d8-495a-8411-b7c43a8481d6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:31.036015 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d9e3c09-f2d8-495a-8411-b7c43a8481d6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:31.036456 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d9e3c09-f2d8-495a-8411-b7c43a8481d6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:31.036897 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d9e3c09-f2d8-495a-8411-b7c43a8481d6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:31.099146 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d9e3c09-f2d8-495a-8411-b7c43a8481d6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:31.106458 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0d9e3c09-f2d8-495a-8411-b7c43a8481d6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1246 microversion: 2.1 time: 0.083032 Aug 08 02:29:31.107016 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 259/536] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:31 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:32.126784 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fcdb0dae-669e-4ee3-8bc8-5d8483a0529b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:32.127403 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-fcdb0dae-669e-4ee3-8bc8-5d8483a0529b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:32.133953 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fcdb0dae-669e-4ee3-8bc8-5d8483a0529b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:32.134419 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fcdb0dae-669e-4ee3-8bc8-5d8483a0529b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:32.134916 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fcdb0dae-669e-4ee3-8bc8-5d8483a0529b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:32.135614 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fcdb0dae-669e-4ee3-8bc8-5d8483a0529b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:32.136067 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fcdb0dae-669e-4ee3-8bc8-5d8483a0529b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:32.136551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fcdb0dae-669e-4ee3-8bc8-5d8483a0529b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:32.201818 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-fcdb0dae-669e-4ee3-8bc8-5d8483a0529b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:32.210074 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fcdb0dae-669e-4ee3-8bc8-5d8483a0529b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1294 microversion: 2.1 time: 0.087863 Aug 08 02:29:32.210671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 278/537] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:32 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:33.231121 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-00b8f9f4-c747-45b2-adc8-5eeddf344714 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:33.232489 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-00b8f9f4-c747-45b2-adc8-5eeddf344714 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:33.239492 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00b8f9f4-c747-45b2-adc8-5eeddf344714 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:33.240025 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00b8f9f4-c747-45b2-adc8-5eeddf344714 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:33.240640 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00b8f9f4-c747-45b2-adc8-5eeddf344714 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:33.241537 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00b8f9f4-c747-45b2-adc8-5eeddf344714 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:33.241990 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00b8f9f4-c747-45b2-adc8-5eeddf344714 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:33.242456 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-00b8f9f4-c747-45b2-adc8-5eeddf344714 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:33.321408 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-00b8f9f4-c747-45b2-adc8-5eeddf344714 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:33.331354 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-00b8f9f4-c747-45b2-adc8-5eeddf344714 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1300 microversion: 2.1 time: 0.103734 Aug 08 02:29:33.333931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 260/538] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:33 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:34.353154 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1c7e7c91-d884-4b63-aa07-e26bfa86933b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:34.353726 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1c7e7c91-d884-4b63-aa07-e26bfa86933b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:34.360920 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c7e7c91-d884-4b63-aa07-e26bfa86933b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:34.361398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c7e7c91-d884-4b63-aa07-e26bfa86933b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:34.361824 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c7e7c91-d884-4b63-aa07-e26bfa86933b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:34.362529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c7e7c91-d884-4b63-aa07-e26bfa86933b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:34.362971 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c7e7c91-d884-4b63-aa07-e26bfa86933b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:34.363383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c7e7c91-d884-4b63-aa07-e26bfa86933b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:34.502194 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1c7e7c91-d884-4b63-aa07-e26bfa86933b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:34.509689 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1c7e7c91-d884-4b63-aa07-e26bfa86933b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.160393 Aug 08 02:29:34.510309 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 279/539] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:34 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:35.529176 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d0c006ff-054c-4bc1-806b-ad714e2ccdf3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:35.529794 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d0c006ff-054c-4bc1-806b-ad714e2ccdf3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:35.536165 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0c006ff-054c-4bc1-806b-ad714e2ccdf3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:35.536642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0c006ff-054c-4bc1-806b-ad714e2ccdf3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:35.537075 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0c006ff-054c-4bc1-806b-ad714e2ccdf3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:35.537763 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0c006ff-054c-4bc1-806b-ad714e2ccdf3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:35.538219 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0c006ff-054c-4bc1-806b-ad714e2ccdf3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:35.538666 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0c006ff-054c-4bc1-806b-ad714e2ccdf3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:35.675707 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d0c006ff-054c-4bc1-806b-ad714e2ccdf3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:35.683103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d0c006ff-054c-4bc1-806b-ad714e2ccdf3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.157697 Aug 08 02:29:35.683671 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 261/540] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:35 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:36.704885 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ba2d6654-75c3-4206-8432-4a64addac223 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:36.705491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ba2d6654-75c3-4206-8432-4a64addac223 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:36.711860 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ba2d6654-75c3-4206-8432-4a64addac223 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:36.712328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ba2d6654-75c3-4206-8432-4a64addac223 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:36.712757 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ba2d6654-75c3-4206-8432-4a64addac223 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:36.713429 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ba2d6654-75c3-4206-8432-4a64addac223 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:36.713874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ba2d6654-75c3-4206-8432-4a64addac223 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:36.714320 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ba2d6654-75c3-4206-8432-4a64addac223 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:36.908484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ba2d6654-75c3-4206-8432-4a64addac223 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:36.916216 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ba2d6654-75c3-4206-8432-4a64addac223 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.215754 Aug 08 02:29:36.916803 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 280/541] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:36 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:37.437322 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-671a337d-f9ea-4051-900c-18d3e3f75321 req-b945c840-1d78-4fbb-b209-e671b47af526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "618e3559-1b3a-43a9-aede-202dbd418c4d", "tag": "4c1d8531-ad0b-4d95-b972-a3fde8050eea"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:29:37.448821 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-671a337d-f9ea-4051-900c-18d3e3f75321 req-b945c840-1d78-4fbb-b209-e671b47af526 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:37.449372 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-671a337d-f9ea-4051-900c-18d3e3f75321 req-b945c840-1d78-4fbb-b209-e671b47af526 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:37.449889 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-671a337d-f9ea-4051-900c-18d3e3f75321 req-b945c840-1d78-4fbb-b209-e671b47af526 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:37.460879 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-671a337d-f9ea-4051-900c-18d3e3f75321 req-b945c840-1d78-4fbb-b209-e671b47af526 service nova] Creating event network-changed:4c1d8531-ad0b-4d95-b972-a3fde8050eea for instance 618e3559-1b3a-43a9-aede-202dbd418c4d on hv-cinder-73306 Aug 08 02:29:37.465892 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-671a337d-f9ea-4051-900c-18d3e3f75321 req-b945c840-1d78-4fbb-b209-e671b47af526 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032305 Aug 08 02:29:37.466516 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 262/542] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:29:37.940954 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-80d73315-dbb4-4050-9932-8f29df944bc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:37.941488 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-80d73315-dbb4-4050-9932-8f29df944bc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:37.947584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-80d73315-dbb4-4050-9932-8f29df944bc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:37.948068 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-80d73315-dbb4-4050-9932-8f29df944bc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:37.948503 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-80d73315-dbb4-4050-9932-8f29df944bc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:37.949183 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-80d73315-dbb4-4050-9932-8f29df944bc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:37.949635 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-80d73315-dbb4-4050-9932-8f29df944bc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:37.950060 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-80d73315-dbb4-4050-9932-8f29df944bc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:38.075186 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-80d73315-dbb4-4050-9932-8f29df944bc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:38.083091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-80d73315-dbb4-4050-9932-8f29df944bc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.146308 Aug 08 02:29:38.083650 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 281/543] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:37 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:29:39.101426 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:39.105680 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-299d0e4d-df17-49ff-ac67-b5f02d7d8149 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:39.106427 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-299d0e4d-df17-49ff-ac67-b5f02d7d8149 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:39.113478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-299d0e4d-df17-49ff-ac67-b5f02d7d8149 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:39.113961 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-299d0e4d-df17-49ff-ac67-b5f02d7d8149 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:39.114439 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-299d0e4d-df17-49ff-ac67-b5f02d7d8149 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:39.115127 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-299d0e4d-df17-49ff-ac67-b5f02d7d8149 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:39.115586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-299d0e4d-df17-49ff-ac67-b5f02d7d8149 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:39.116011 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-299d0e4d-df17-49ff-ac67-b5f02d7d8149 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:39.259987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-299d0e4d-df17-49ff-ac67-b5f02d7d8149 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:39.267826 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-299d0e4d-df17-49ff-ac67-b5f02d7d8149 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.167784 Aug 08 02:29:39.268392 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 263/544] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:39 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:40.288085 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-bd028753-34c2-445f-be87-1627a1c1cd05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:40.288701 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-bd028753-34c2-445f-be87-1627a1c1cd05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:40.290817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:40.291718 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=6 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:40.312497 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bd028753-34c2-445f-be87-1627a1c1cd05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:40.312497 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bd028753-34c2-445f-be87-1627a1c1cd05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:40.312497 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bd028753-34c2-445f-be87-1627a1c1cd05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:40.312497 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bd028753-34c2-445f-be87-1627a1c1cd05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:40.312967 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bd028753-34c2-445f-be87-1627a1c1cd05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:40.312967 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bd028753-34c2-445f-be87-1627a1c1cd05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:40.385871 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7d637483-e971-4708-9d22-27cf1f705249 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:29:40.394237 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d637483-e971-4708-9d22-27cf1f705249 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:40.394904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d637483-e971-4708-9d22-27cf1f705249 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:40.395343 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d637483-e971-4708-9d22-27cf1f705249 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:40.474328 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7d637483-e971-4708-9d22-27cf1f705249 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Going to try to stop instance {{(pid=117642) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 02:29:40.533454 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7d637483-e971-4708-9d22-27cf1f705249 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "POST /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/action" status: 202 len: 0 microversion: 2.1 time: 0.151300 Aug 08 02:29:40.539179 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 264/545] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:29:40 2022] POST /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:29:40.544165 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-877ca388-c0ac-407b-b13f-df3450abb8c2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:40.544474 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-bd028753-34c2-445f-be87-1627a1c1cd05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:40.544866 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-877ca388-c0ac-407b-b13f-df3450abb8c2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:40.551952 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-877ca388-c0ac-407b-b13f-df3450abb8c2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:40.552473 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-877ca388-c0ac-407b-b13f-df3450abb8c2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:40.552590 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-bd028753-34c2-445f-be87-1627a1c1cd05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.268236 Aug 08 02:29:40.552906 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-877ca388-c0ac-407b-b13f-df3450abb8c2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:40.553603 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-877ca388-c0ac-407b-b13f-df3450abb8c2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:40.554171 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-877ca388-c0ac-407b-b13f-df3450abb8c2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:40.554615 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-877ca388-c0ac-407b-b13f-df3450abb8c2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:40.565853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 282/546] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:40 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:40.694644 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-877ca388-c0ac-407b-b13f-df3450abb8c2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:40.702480 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-877ca388-c0ac-407b-b13f-df3450abb8c2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.162623 Aug 08 02:29:40.703636 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 265/547] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:40 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:41.572936 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-216989a1-d278-4c55-94bb-825482a5c0c8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:41.573467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-216989a1-d278-4c55-94bb-825482a5c0c8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:41.580038 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-216989a1-d278-4c55-94bb-825482a5c0c8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:41.580523 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-216989a1-d278-4c55-94bb-825482a5c0c8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:41.580953 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-216989a1-d278-4c55-94bb-825482a5c0c8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:41.581648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-216989a1-d278-4c55-94bb-825482a5c0c8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:41.582291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-216989a1-d278-4c55-94bb-825482a5c0c8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:41.582546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-216989a1-d278-4c55-94bb-825482a5c0c8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:41.724711 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3a2d5e38-e708-4df1-a8c6-f4380f01baf3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:41.725361 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3a2d5e38-e708-4df1-a8c6-f4380f01baf3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:41.733452 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a2d5e38-e708-4df1-a8c6-f4380f01baf3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:41.735043 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a2d5e38-e708-4df1-a8c6-f4380f01baf3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:41.735661 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a2d5e38-e708-4df1-a8c6-f4380f01baf3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:41.736993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a2d5e38-e708-4df1-a8c6-f4380f01baf3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:41.737115 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-216989a1-d278-4c55-94bb-825482a5c0c8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:41.737728 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a2d5e38-e708-4df1-a8c6-f4380f01baf3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:41.738817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a2d5e38-e708-4df1-a8c6-f4380f01baf3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:41.746137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-216989a1-d278-4c55-94bb-825482a5c0c8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.177007 Aug 08 02:29:41.746732 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 283/548] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:41 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:41.878054 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a2d5e38-e708-4df1-a8c6-f4380f01baf3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:41.886065 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3a2d5e38-e708-4df1-a8c6-f4380f01baf3 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.165590 Aug 08 02:29:41.886659 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 266/549] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:41 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:42.767856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d216d4aa-6b98-4fb7-ad2c-237dfd3f00d4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:42.768618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d216d4aa-6b98-4fb7-ad2c-237dfd3f00d4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:42.778077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0dd5cb4b-c6c9-45d5-93fd-2c2668cd01c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:42.778512 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0dd5cb4b-c6c9-45d5-93fd-2c2668cd01c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:42.784679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dd5cb4b-c6c9-45d5-93fd-2c2668cd01c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:42.785156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dd5cb4b-c6c9-45d5-93fd-2c2668cd01c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:42.788214 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d216d4aa-6b98-4fb7-ad2c-237dfd3f00d4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:42.788692 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d216d4aa-6b98-4fb7-ad2c-237dfd3f00d4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:42.789112 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d216d4aa-6b98-4fb7-ad2c-237dfd3f00d4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:42.789965 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dd5cb4b-c6c9-45d5-93fd-2c2668cd01c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:42.790682 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dd5cb4b-c6c9-45d5-93fd-2c2668cd01c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:42.791129 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dd5cb4b-c6c9-45d5-93fd-2c2668cd01c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:42.791546 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0dd5cb4b-c6c9-45d5-93fd-2c2668cd01c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:42.794468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d216d4aa-6b98-4fb7-ad2c-237dfd3f00d4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:42.795043 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d216d4aa-6b98-4fb7-ad2c-237dfd3f00d4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:42.795482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d216d4aa-6b98-4fb7-ad2c-237dfd3f00d4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:42.941314 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-0dd5cb4b-c6c9-45d5-93fd-2c2668cd01c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lazy-loading 'services' on Instance uuid f1ea1a9c-fd55-4d21-909a-235e4422e6d6 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:29:42.963703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d216d4aa-6b98-4fb7-ad2c-237dfd3f00d4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:42.971588 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d216d4aa-6b98-4fb7-ad2c-237dfd3f00d4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.208342 Aug 08 02:29:42.972669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 284/550] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:42 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:42.978804 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f1712b21-f9f2-4847-a055-3c8b07754369 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:42.979578 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f1712b21-f9f2-4847-a055-3c8b07754369 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:42.986109 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f1712b21-f9f2-4847-a055-3c8b07754369 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:42.986604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f1712b21-f9f2-4847-a055-3c8b07754369 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:42.987033 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f1712b21-f9f2-4847-a055-3c8b07754369 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:42.987711 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f1712b21-f9f2-4847-a055-3c8b07754369 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:42.988157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f1712b21-f9f2-4847-a055-3c8b07754369 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:42.988569 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f1712b21-f9f2-4847-a055-3c8b07754369 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:43.062213 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0dd5cb4b-c6c9-45d5-93fd-2c2668cd01c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6/os-volume_attachments/0d7e0bb5-35e2-4d49-b00c-3566a862319e" status: 202 len: 0 microversion: 2.1 time: 0.288347 Aug 08 02:29:43.063581 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 267/551] 10.222.0.39 () {58 vars in 1416 bytes} [Mon Aug 8 02:29:42 2022] DELETE /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6/os-volume_attachments/0d7e0bb5-35e2-4d49-b00c-3566a862319e => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:29:43.145708 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f1712b21-f9f2-4847-a055-3c8b07754369 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:43.153597 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f1712b21-f9f2-4847-a055-3c8b07754369 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.179772 Aug 08 02:29:43.154155 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 285/552] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:42 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:43.993761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d7a92070-0435-46a1-8a5f-8658fbe649be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:43.994491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d7a92070-0435-46a1-8a5f-8658fbe649be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:44.001252 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7a92070-0435-46a1-8a5f-8658fbe649be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:44.001732 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7a92070-0435-46a1-8a5f-8658fbe649be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:44.002185 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7a92070-0435-46a1-8a5f-8658fbe649be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:44.002897 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7a92070-0435-46a1-8a5f-8658fbe649be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:44.003347 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7a92070-0435-46a1-8a5f-8658fbe649be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:44.003772 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7a92070-0435-46a1-8a5f-8658fbe649be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:44.138192 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d7a92070-0435-46a1-8a5f-8658fbe649be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:44.146496 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d7a92070-0435-46a1-8a5f-8658fbe649be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.157398 Aug 08 02:29:44.147073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 268/553] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:43 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:44.175786 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3ce1561a-49b8-4a9f-8f63-5685f7cdc0ad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:44.176389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3ce1561a-49b8-4a9f-8f63-5685f7cdc0ad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:44.183481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3ce1561a-49b8-4a9f-8f63-5685f7cdc0ad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:44.183959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3ce1561a-49b8-4a9f-8f63-5685f7cdc0ad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:44.184424 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3ce1561a-49b8-4a9f-8f63-5685f7cdc0ad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:44.185106 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3ce1561a-49b8-4a9f-8f63-5685f7cdc0ad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:44.185651 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3ce1561a-49b8-4a9f-8f63-5685f7cdc0ad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:44.186158 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3ce1561a-49b8-4a9f-8f63-5685f7cdc0ad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:44.317391 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3ce1561a-49b8-4a9f-8f63-5685f7cdc0ad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:44.325183 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3ce1561a-49b8-4a9f-8f63-5685f7cdc0ad tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.153574 Aug 08 02:29:44.325738 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 286/554] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:44 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:45.167158 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-218b9bf0-18f9-4be7-80d4-a37278e253ac tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:45.167835 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-218b9bf0-18f9-4be7-80d4-a37278e253ac tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:45.174559 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-218b9bf0-18f9-4be7-80d4-a37278e253ac tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:45.175043 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-218b9bf0-18f9-4be7-80d4-a37278e253ac tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:45.175478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-218b9bf0-18f9-4be7-80d4-a37278e253ac tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:45.176165 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-218b9bf0-18f9-4be7-80d4-a37278e253ac tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:45.176615 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-218b9bf0-18f9-4be7-80d4-a37278e253ac tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:45.177035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-218b9bf0-18f9-4be7-80d4-a37278e253ac tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:45.310513 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-218b9bf0-18f9-4be7-80d4-a37278e253ac tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:45.319451 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-218b9bf0-18f9-4be7-80d4-a37278e253ac tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.155799 Aug 08 02:29:45.320192 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 269/555] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:45 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:45.346780 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0de2facd-0838-4396-b328-fbd5029d86f2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:45.347436 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0de2facd-0838-4396-b328-fbd5029d86f2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:45.353721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0de2facd-0838-4396-b328-fbd5029d86f2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:45.354211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0de2facd-0838-4396-b328-fbd5029d86f2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:45.354648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0de2facd-0838-4396-b328-fbd5029d86f2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:45.355326 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0de2facd-0838-4396-b328-fbd5029d86f2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:45.355767 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0de2facd-0838-4396-b328-fbd5029d86f2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:45.356180 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0de2facd-0838-4396-b328-fbd5029d86f2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:45.494970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0de2facd-0838-4396-b328-fbd5029d86f2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:45.503376 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0de2facd-0838-4396-b328-fbd5029d86f2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.160468 Aug 08 02:29:45.503951 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 287/556] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:45 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:46.339976 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f60bd522-80e1-4163-a36f-c5db06d340ce tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:46.340623 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f60bd522-80e1-4163-a36f-c5db06d340ce tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:46.347465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f60bd522-80e1-4163-a36f-c5db06d340ce tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:46.347946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f60bd522-80e1-4163-a36f-c5db06d340ce tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:46.348382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f60bd522-80e1-4163-a36f-c5db06d340ce tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:46.349073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f60bd522-80e1-4163-a36f-c5db06d340ce tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:46.349520 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f60bd522-80e1-4163-a36f-c5db06d340ce tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:46.349936 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f60bd522-80e1-4163-a36f-c5db06d340ce tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:46.479380 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f60bd522-80e1-4163-a36f-c5db06d340ce tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:46.487363 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f60bd522-80e1-4163-a36f-c5db06d340ce tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.151209 Aug 08 02:29:46.487934 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 270/557] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:46 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:46.524744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3cc12e20-09d5-4170-bc50-8e35b047fea5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:46.525435 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3cc12e20-09d5-4170-bc50-8e35b047fea5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:46.532644 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3cc12e20-09d5-4170-bc50-8e35b047fea5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:46.533195 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3cc12e20-09d5-4170-bc50-8e35b047fea5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:46.533688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3cc12e20-09d5-4170-bc50-8e35b047fea5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:46.534490 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3cc12e20-09d5-4170-bc50-8e35b047fea5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:46.534932 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3cc12e20-09d5-4170-bc50-8e35b047fea5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:46.535346 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3cc12e20-09d5-4170-bc50-8e35b047fea5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:46.671012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3cc12e20-09d5-4170-bc50-8e35b047fea5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:46.679206 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3cc12e20-09d5-4170-bc50-8e35b047fea5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.158283 Aug 08 02:29:46.679701 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 288/558] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:46 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:47.507813 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b573e965-1224-4c98-bdcf-c8cb91b92537 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:47.508500 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b573e965-1224-4c98-bdcf-c8cb91b92537 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:47.515126 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b573e965-1224-4c98-bdcf-c8cb91b92537 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:47.515609 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b573e965-1224-4c98-bdcf-c8cb91b92537 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:47.516042 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b573e965-1224-4c98-bdcf-c8cb91b92537 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:47.516731 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b573e965-1224-4c98-bdcf-c8cb91b92537 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:47.517184 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b573e965-1224-4c98-bdcf-c8cb91b92537 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:47.517608 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b573e965-1224-4c98-bdcf-c8cb91b92537 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:47.643317 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b573e965-1224-4c98-bdcf-c8cb91b92537 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:47.650646 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b573e965-1224-4c98-bdcf-c8cb91b92537 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.146793 Aug 08 02:29:47.651216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 271/559] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:47 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:47.699474 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-752dcb26-f651-4c57-b086-d1d9eb099414 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:47.700077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-752dcb26-f651-4c57-b086-d1d9eb099414 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:47.706806 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-752dcb26-f651-4c57-b086-d1d9eb099414 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:47.707295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-752dcb26-f651-4c57-b086-d1d9eb099414 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:47.707719 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-752dcb26-f651-4c57-b086-d1d9eb099414 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:47.708399 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-752dcb26-f651-4c57-b086-d1d9eb099414 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:47.708843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-752dcb26-f651-4c57-b086-d1d9eb099414 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:47.709258 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-752dcb26-f651-4c57-b086-d1d9eb099414 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:47.837409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-752dcb26-f651-4c57-b086-d1d9eb099414 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:47.846025 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-752dcb26-f651-4c57-b086-d1d9eb099414 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.150338 Aug 08 02:29:47.846613 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 289/560] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:47 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:48.670999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-68a1d2dd-7bb4-4959-a98e-3363719cb66c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:48.671547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-68a1d2dd-7bb4-4959-a98e-3363719cb66c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:48.677892 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68a1d2dd-7bb4-4959-a98e-3363719cb66c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:48.678412 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68a1d2dd-7bb4-4959-a98e-3363719cb66c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:48.678852 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68a1d2dd-7bb4-4959-a98e-3363719cb66c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:48.679541 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68a1d2dd-7bb4-4959-a98e-3363719cb66c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:48.679997 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68a1d2dd-7bb4-4959-a98e-3363719cb66c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:48.680421 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68a1d2dd-7bb4-4959-a98e-3363719cb66c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:48.867295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-799a97ab-19e2-43ab-be68-bcd57a4c8cbd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:48.868193 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-799a97ab-19e2-43ab-be68-bcd57a4c8cbd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:48.874905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-799a97ab-19e2-43ab-be68-bcd57a4c8cbd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:48.876014 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-799a97ab-19e2-43ab-be68-bcd57a4c8cbd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:48.876440 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-799a97ab-19e2-43ab-be68-bcd57a4c8cbd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:48.877130 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-799a97ab-19e2-43ab-be68-bcd57a4c8cbd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:48.877867 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-799a97ab-19e2-43ab-be68-bcd57a4c8cbd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:48.878310 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-799a97ab-19e2-43ab-be68-bcd57a4c8cbd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:49.013502 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-799a97ab-19e2-43ab-be68-bcd57a4c8cbd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:49.021748 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-799a97ab-19e2-43ab-be68-bcd57a4c8cbd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.158245 Aug 08 02:29:49.022703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 290/561] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:48 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:29:49.057419 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-68a1d2dd-7bb4-4959-a98e-3363719cb66c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:49.065604 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-68a1d2dd-7bb4-4959-a98e-3363719cb66c tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.398511 Aug 08 02:29:49.066169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 272/562] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:48 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:50.043221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c9900fa7-7646-49b3-a0fa-44cf89297611 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:50.043831 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c9900fa7-7646-49b3-a0fa-44cf89297611 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:50.050163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c9900fa7-7646-49b3-a0fa-44cf89297611 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:50.050672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c9900fa7-7646-49b3-a0fa-44cf89297611 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:50.051102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c9900fa7-7646-49b3-a0fa-44cf89297611 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:50.051779 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c9900fa7-7646-49b3-a0fa-44cf89297611 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:50.052225 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c9900fa7-7646-49b3-a0fa-44cf89297611 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:50.052645 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c9900fa7-7646-49b3-a0fa-44cf89297611 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:50.085655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-41d3a00c-dde8-478f-aa61-c3d8104c871a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:50.086399 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-41d3a00c-dde8-478f-aa61-c3d8104c871a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:50.092906 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d3a00c-dde8-478f-aa61-c3d8104c871a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:50.093388 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d3a00c-dde8-478f-aa61-c3d8104c871a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:50.093820 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d3a00c-dde8-478f-aa61-c3d8104c871a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:50.094534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d3a00c-dde8-478f-aa61-c3d8104c871a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:50.094982 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d3a00c-dde8-478f-aa61-c3d8104c871a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:50.095404 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d3a00c-dde8-478f-aa61-c3d8104c871a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:50.184122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c9900fa7-7646-49b3-a0fa-44cf89297611 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:50.193079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c9900fa7-7646-49b3-a0fa-44cf89297611 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.153647 Aug 08 02:29:50.193641 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 291/563] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:50 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:29:50.227840 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-41d3a00c-dde8-478f-aa61-c3d8104c871a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:50.235148 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-41d3a00c-dde8-478f-aa61-c3d8104c871a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.153316 Aug 08 02:29:50.235729 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 273/564] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:50 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:29:51.215844 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b70cf346-9b08-4c64-a25d-d63c93056c7b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:51.216436 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b70cf346-9b08-4c64-a25d-d63c93056c7b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:51.223535 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b70cf346-9b08-4c64-a25d-d63c93056c7b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:51.224007 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b70cf346-9b08-4c64-a25d-d63c93056c7b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:51.224433 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b70cf346-9b08-4c64-a25d-d63c93056c7b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:51.225110 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b70cf346-9b08-4c64-a25d-d63c93056c7b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:51.225548 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b70cf346-9b08-4c64-a25d-d63c93056c7b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:51.225965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b70cf346-9b08-4c64-a25d-d63c93056c7b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:51.255349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-10b127d7-ee87-460b-98d9-f67de268b2d2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:51.256091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-10b127d7-ee87-460b-98d9-f67de268b2d2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:51.263127 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b127d7-ee87-460b-98d9-f67de268b2d2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:51.263241 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b127d7-ee87-460b-98d9-f67de268b2d2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:51.263701 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b127d7-ee87-460b-98d9-f67de268b2d2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:51.264559 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b127d7-ee87-460b-98d9-f67de268b2d2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:51.265135 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b127d7-ee87-460b-98d9-f67de268b2d2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:51.265459 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10b127d7-ee87-460b-98d9-f67de268b2d2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:51.285547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:51.364132 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b70cf346-9b08-4c64-a25d-d63c93056c7b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:51.372012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b70cf346-9b08-4c64-a25d-d63c93056c7b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.160660 Aug 08 02:29:51.372570 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 292/565] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:51 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:51.399618 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-10b127d7-ee87-460b-98d9-f67de268b2d2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:51.407594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-10b127d7-ee87-460b-98d9-f67de268b2d2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.156071 Aug 08 02:29:51.408156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 274/566] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:51 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:29:52.392872 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d52a23b1-5569-4cd9-a255-8354b034b362 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:52.393486 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d52a23b1-5569-4cd9-a255-8354b034b362 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:52.399806 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d52a23b1-5569-4cd9-a255-8354b034b362 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:52.400289 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d52a23b1-5569-4cd9-a255-8354b034b362 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:52.400722 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d52a23b1-5569-4cd9-a255-8354b034b362 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:52.401406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d52a23b1-5569-4cd9-a255-8354b034b362 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:52.401859 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d52a23b1-5569-4cd9-a255-8354b034b362 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:52.402305 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d52a23b1-5569-4cd9-a255-8354b034b362 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:52.406166 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:52.427850 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-479fbcf0-f495-4b42-9ded-b1bec69c2301 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:52.428570 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-479fbcf0-f495-4b42-9ded-b1bec69c2301 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:52.435261 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-479fbcf0-f495-4b42-9ded-b1bec69c2301 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:52.435738 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-479fbcf0-f495-4b42-9ded-b1bec69c2301 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:52.436164 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-479fbcf0-f495-4b42-9ded-b1bec69c2301 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:52.436843 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-479fbcf0-f495-4b42-9ded-b1bec69c2301 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:52.437288 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-479fbcf0-f495-4b42-9ded-b1bec69c2301 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:52.437702 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-479fbcf0-f495-4b42-9ded-b1bec69c2301 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:52.541651 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d52a23b1-5569-4cd9-a255-8354b034b362 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:52.554325 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d52a23b1-5569-4cd9-a255-8354b034b362 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.165004 Aug 08 02:29:52.554902 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 293/567] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:52 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:52.581483 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-479fbcf0-f495-4b42-9ded-b1bec69c2301 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:52.588814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-479fbcf0-f495-4b42-9ded-b1bec69c2301 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.164833 Aug 08 02:29:52.589381 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 275/568] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:52 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:29:53.575283 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-37863372-097a-4834-8963-3f8fe453ad64 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:53.575821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-37863372-097a-4834-8963-3f8fe453ad64 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:53.582675 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37863372-097a-4834-8963-3f8fe453ad64 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:53.583151 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37863372-097a-4834-8963-3f8fe453ad64 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:53.583578 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37863372-097a-4834-8963-3f8fe453ad64 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:53.584443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37863372-097a-4834-8963-3f8fe453ad64 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:53.584878 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37863372-097a-4834-8963-3f8fe453ad64 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:53.585295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-37863372-097a-4834-8963-3f8fe453ad64 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:53.613931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4e27f06d-0327-4741-b273-27fac103fb04 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:53.614630 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4e27f06d-0327-4741-b273-27fac103fb04 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:53.620903 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e27f06d-0327-4741-b273-27fac103fb04 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:53.621402 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e27f06d-0327-4741-b273-27fac103fb04 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:53.621836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e27f06d-0327-4741-b273-27fac103fb04 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:53.622559 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e27f06d-0327-4741-b273-27fac103fb04 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:53.623024 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e27f06d-0327-4741-b273-27fac103fb04 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:53.623424 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4e27f06d-0327-4741-b273-27fac103fb04 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:53.744206 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-37863372-097a-4834-8963-3f8fe453ad64 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:53.752129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-37863372-097a-4834-8963-3f8fe453ad64 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.180678 Aug 08 02:29:53.752691 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 294/569] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:53 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:53.757430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-08869bbb-bd59-4ca9-9820-3ddd8f800704 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:53.757914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-08869bbb-bd59-4ca9-9820-3ddd8f800704 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:53.763265 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4e27f06d-0327-4741-b273-27fac103fb04 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:53.765726 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-08869bbb-bd59-4ca9-9820-3ddd8f800704 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:53.766295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-08869bbb-bd59-4ca9-9820-3ddd8f800704 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:53.766728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-08869bbb-bd59-4ca9-9820-3ddd8f800704 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:53.767412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-08869bbb-bd59-4ca9-9820-3ddd8f800704 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:53.767881 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-08869bbb-bd59-4ca9-9820-3ddd8f800704 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:53.768313 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-08869bbb-bd59-4ca9-9820-3ddd8f800704 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:53.770770 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4e27f06d-0327-4741-b273-27fac103fb04 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.164634 Aug 08 02:29:53.771413 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 276/570] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:53 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:53.792871 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-08869bbb-bd59-4ca9-9820-3ddd8f800704 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:29:53.872389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-08869bbb-bd59-4ca9-9820-3ddd8f800704 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 204 len: 0 microversion: 2.1 time: 0.118111 Aug 08 02:29:53.873311 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 295/571] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:29:53 2022] DELETE /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:29:53.883038 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f0df10f6-3a5c-4b2e-8a00-d9c9f81eb3e3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:53.883995 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f0df10f6-3a5c-4b2e-8a00-d9c9f81eb3e3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:53.890236 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0df10f6-3a5c-4b2e-8a00-d9c9f81eb3e3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:53.890636 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0df10f6-3a5c-4b2e-8a00-d9c9f81eb3e3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:53.891095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0df10f6-3a5c-4b2e-8a00-d9c9f81eb3e3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:53.891781 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0df10f6-3a5c-4b2e-8a00-d9c9f81eb3e3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:53.892227 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0df10f6-3a5c-4b2e-8a00-d9c9f81eb3e3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:53.892638 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0df10f6-3a5c-4b2e-8a00-d9c9f81eb3e3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:53.995335 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-6275445f-019a-4106-be66-3a96f1628121 req-d622db5c-86f7-4794-aaa3-aa7fac97f08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618e3559-1b3a-43a9-aede-202dbd418c4d", "name": "network-vif-plugged", "status": "completed", "tag": "4c1d8531-ad0b-4d95-b972-a3fde8050eea"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:29:54.006800 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-6275445f-019a-4106-be66-3a96f1628121 req-d622db5c-86f7-4794-aaa3-aa7fac97f08f service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:54.007351 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-6275445f-019a-4106-be66-3a96f1628121 req-d622db5c-86f7-4794-aaa3-aa7fac97f08f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:54.007917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-6275445f-019a-4106-be66-3a96f1628121 req-d622db5c-86f7-4794-aaa3-aa7fac97f08f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:54.023237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-6275445f-019a-4106-be66-3a96f1628121 req-d622db5c-86f7-4794-aaa3-aa7fac97f08f service nova] Creating event network-vif-plugged:4c1d8531-ad0b-4d95-b972-a3fde8050eea for instance 618e3559-1b3a-43a9-aede-202dbd418c4d on hv-cinder-73306 Aug 08 02:29:54.028113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-6275445f-019a-4106-be66-3a96f1628121 req-d622db5c-86f7-4794-aaa3-aa7fac97f08f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036759 Aug 08 02:29:54.029274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 296/572] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:29:54.045015 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f0df10f6-3a5c-4b2e-8a00-d9c9f81eb3e3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:54.055394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f0df10f6-3a5c-4b2e-8a00-d9c9f81eb3e3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.177193 Aug 08 02:29:54.070240 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 277/573] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:53 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:54.773777 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-aafb1e24-6823-45ab-baf7-f40757be81c7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:54.774501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-aafb1e24-6823-45ab-baf7-f40757be81c7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:54.780776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-aafb1e24-6823-45ab-baf7-f40757be81c7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:54.781278 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-aafb1e24-6823-45ab-baf7-f40757be81c7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:54.781752 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-aafb1e24-6823-45ab-baf7-f40757be81c7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:54.782468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-aafb1e24-6823-45ab-baf7-f40757be81c7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:54.782915 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-aafb1e24-6823-45ab-baf7-f40757be81c7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:54.783331 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-aafb1e24-6823-45ab-baf7-f40757be81c7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:54.791479 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e524c71f-3fe6-4d57-985f-b04fa2d08e60 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:54.792095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e524c71f-3fe6-4d57-985f-b04fa2d08e60 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:54.798461 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e524c71f-3fe6-4d57-985f-b04fa2d08e60 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:54.798941 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e524c71f-3fe6-4d57-985f-b04fa2d08e60 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:54.799381 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e524c71f-3fe6-4d57-985f-b04fa2d08e60 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:54.800096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e524c71f-3fe6-4d57-985f-b04fa2d08e60 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:54.800550 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e524c71f-3fe6-4d57-985f-b04fa2d08e60 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:54.801050 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e524c71f-3fe6-4d57-985f-b04fa2d08e60 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:54.913923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-aafb1e24-6823-45ab-baf7-f40757be81c7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:54.921936 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-aafb1e24-6823-45ab-baf7-f40757be81c7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.152800 Aug 08 02:29:54.923036 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 297/574] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:54 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:54.928974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e524c71f-3fe6-4d57-985f-b04fa2d08e60 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:54.936446 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e524c71f-3fe6-4d57-985f-b04fa2d08e60 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.148815 Aug 08 02:29:54.937002 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 278/575] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:54 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:29:55.076122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-442aec92-a1ff-4821-902d-acfa2823d87e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:55.076757 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-442aec92-a1ff-4821-902d-acfa2823d87e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:55.082640 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-442aec92-a1ff-4821-902d-acfa2823d87e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:55.083109 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-442aec92-a1ff-4821-902d-acfa2823d87e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:55.083532 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-442aec92-a1ff-4821-902d-acfa2823d87e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:55.084200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-442aec92-a1ff-4821-902d-acfa2823d87e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:55.084642 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-442aec92-a1ff-4821-902d-acfa2823d87e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:55.085053 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-442aec92-a1ff-4821-902d-acfa2823d87e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:55.214606 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-442aec92-a1ff-4821-902d-acfa2823d87e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:55.222788 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-442aec92-a1ff-4821-902d-acfa2823d87e tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.150429 Aug 08 02:29:55.223352 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 298/576] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:55 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:55.944171 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-705f1e15-3dc3-4f39-aa03-be50edaffe70 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:55.944736 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-705f1e15-3dc3-4f39-aa03-be50edaffe70 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:55.951091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-705f1e15-3dc3-4f39-aa03-be50edaffe70 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:55.951569 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-705f1e15-3dc3-4f39-aa03-be50edaffe70 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:55.952003 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-705f1e15-3dc3-4f39-aa03-be50edaffe70 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:55.952691 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-705f1e15-3dc3-4f39-aa03-be50edaffe70 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:55.953141 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-705f1e15-3dc3-4f39-aa03-be50edaffe70 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:55.953561 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-705f1e15-3dc3-4f39-aa03-be50edaffe70 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:55.957351 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-789ab459-7865-45ef-b138-1dcd8f039390 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:55.957956 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-789ab459-7865-45ef-b138-1dcd8f039390 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:55.964190 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-789ab459-7865-45ef-b138-1dcd8f039390 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:55.964681 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-789ab459-7865-45ef-b138-1dcd8f039390 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:55.965087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-789ab459-7865-45ef-b138-1dcd8f039390 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:55.965764 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-789ab459-7865-45ef-b138-1dcd8f039390 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:55.966207 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-789ab459-7865-45ef-b138-1dcd8f039390 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:55.966648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-789ab459-7865-45ef-b138-1dcd8f039390 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:56.086095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-705f1e15-3dc3-4f39-aa03-be50edaffe70 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:56.094098 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-705f1e15-3dc3-4f39-aa03-be50edaffe70 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.153779 Aug 08 02:29:56.094715 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 279/577] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:55 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:56.094834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-789ab459-7865-45ef-b138-1dcd8f039390 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:56.102084 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-789ab459-7865-45ef-b138-1dcd8f039390 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.148631 Aug 08 02:29:56.102665 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 299/578] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:55 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:29:56.243903 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-741cda70-dd7c-4a99-9e9e-1c7b4fa9e127 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:56.244476 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-741cda70-dd7c-4a99-9e9e-1c7b4fa9e127 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:56.250919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-741cda70-dd7c-4a99-9e9e-1c7b4fa9e127 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:56.251399 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-741cda70-dd7c-4a99-9e9e-1c7b4fa9e127 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:56.251834 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-741cda70-dd7c-4a99-9e9e-1c7b4fa9e127 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:56.252514 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-741cda70-dd7c-4a99-9e9e-1c7b4fa9e127 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:56.252963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-741cda70-dd7c-4a99-9e9e-1c7b4fa9e127 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:56.253383 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-741cda70-dd7c-4a99-9e9e-1c7b4fa9e127 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:56.382214 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-741cda70-dd7c-4a99-9e9e-1c7b4fa9e127 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:56.389753 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-741cda70-dd7c-4a99-9e9e-1c7b4fa9e127 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.149795 Aug 08 02:29:56.390339 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 280/579] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:56 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:57.115519 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ff3a6aec-5da0-45e5-a463-90cf1c748494 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:57.116145 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ff3a6aec-5da0-45e5-a463-90cf1c748494 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:57.122036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-62574ed3-57e5-4855-a877-b4607b73cffb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:57.122692 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ff3a6aec-5da0-45e5-a463-90cf1c748494 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:57.122830 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-62574ed3-57e5-4855-a877-b4607b73cffb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:57.123167 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ff3a6aec-5da0-45e5-a463-90cf1c748494 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:57.123589 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ff3a6aec-5da0-45e5-a463-90cf1c748494 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:57.124273 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ff3a6aec-5da0-45e5-a463-90cf1c748494 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:57.124719 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ff3a6aec-5da0-45e5-a463-90cf1c748494 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:57.125025 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:57.125139 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ff3a6aec-5da0-45e5-a463-90cf1c748494 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:57.130430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62574ed3-57e5-4855-a877-b4607b73cffb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:57.130913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62574ed3-57e5-4855-a877-b4607b73cffb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:57.131348 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62574ed3-57e5-4855-a877-b4607b73cffb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:57.132040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62574ed3-57e5-4855-a877-b4607b73cffb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:57.132496 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62574ed3-57e5-4855-a877-b4607b73cffb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:57.132919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62574ed3-57e5-4855-a877-b4607b73cffb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:57.255650 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ff3a6aec-5da0-45e5-a463-90cf1c748494 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:57.263528 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ff3a6aec-5da0-45e5-a463-90cf1c748494 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.151839 Aug 08 02:29:57.264096 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 300/580] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:57 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:57.266377 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-62574ed3-57e5-4855-a877-b4607b73cffb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:57.273764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-62574ed3-57e5-4855-a877-b4607b73cffb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.155539 Aug 08 02:29:57.274491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 281/581] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:57 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:29:57.411114 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b76bd858-fcab-461e-aff2-ebc498ca5ecf tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:57.411683 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b76bd858-fcab-461e-aff2-ebc498ca5ecf tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:57.417533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b76bd858-fcab-461e-aff2-ebc498ca5ecf tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:57.418012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b76bd858-fcab-461e-aff2-ebc498ca5ecf tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:57.418467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b76bd858-fcab-461e-aff2-ebc498ca5ecf tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:57.419143 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b76bd858-fcab-461e-aff2-ebc498ca5ecf tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:57.419585 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b76bd858-fcab-461e-aff2-ebc498ca5ecf tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:57.420027 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b76bd858-fcab-461e-aff2-ebc498ca5ecf tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:57.548190 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b76bd858-fcab-461e-aff2-ebc498ca5ecf tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:57.555501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b76bd858-fcab-461e-aff2-ebc498ca5ecf tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.148829 Aug 08 02:29:57.556065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 301/582] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:57 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:58.284918 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b79dc915-9d17-44ec-99f0-d59061acbdc4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:58.285566 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b79dc915-9d17-44ec-99f0-d59061acbdc4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:58.292433 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b79dc915-9d17-44ec-99f0-d59061acbdc4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:58.292914 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b79dc915-9d17-44ec-99f0-d59061acbdc4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:58.293345 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b79dc915-9d17-44ec-99f0-d59061acbdc4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:58.294034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b79dc915-9d17-44ec-99f0-d59061acbdc4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:58.294425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a7abd195-c7ea-48e8-883b-01edc3d30f58 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:58.294869 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b79dc915-9d17-44ec-99f0-d59061acbdc4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:58.294965 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b79dc915-9d17-44ec-99f0-d59061acbdc4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:58.295704 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a7abd195-c7ea-48e8-883b-01edc3d30f58 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:58.298146 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:29:58.303386 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a7abd195-c7ea-48e8-883b-01edc3d30f58 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:58.303862 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a7abd195-c7ea-48e8-883b-01edc3d30f58 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:58.304286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a7abd195-c7ea-48e8-883b-01edc3d30f58 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:58.304972 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a7abd195-c7ea-48e8-883b-01edc3d30f58 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:58.305415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a7abd195-c7ea-48e8-883b-01edc3d30f58 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:58.305824 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a7abd195-c7ea-48e8-883b-01edc3d30f58 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:58.424759 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b79dc915-9d17-44ec-99f0-d59061acbdc4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:58.433465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b79dc915-9d17-44ec-99f0-d59061acbdc4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.152189 Aug 08 02:29:58.434031 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 282/583] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:58 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:58.436501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a7abd195-c7ea-48e8-883b-01edc3d30f58 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:58.444918 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a7abd195-c7ea-48e8-883b-01edc3d30f58 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.154140 Aug 08 02:29:58.445963 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 302/584] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:58 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:29:58.576907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-87e662e3-5f07-4999-addf-05ffa0c0854a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:58.577547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-87e662e3-5f07-4999-addf-05ffa0c0854a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:58.584103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87e662e3-5f07-4999-addf-05ffa0c0854a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:58.584582 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87e662e3-5f07-4999-addf-05ffa0c0854a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:58.585012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87e662e3-5f07-4999-addf-05ffa0c0854a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:58.585691 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87e662e3-5f07-4999-addf-05ffa0c0854a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:58.586143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87e662e3-5f07-4999-addf-05ffa0c0854a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:58.586588 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-87e662e3-5f07-4999-addf-05ffa0c0854a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:58.711496 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-87e662e3-5f07-4999-addf-05ffa0c0854a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:58.718923 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-87e662e3-5f07-4999-addf-05ffa0c0854a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.145823 Aug 08 02:29:58.719396 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 283/585] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:58 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:59.456310 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4d5dac2d-aca4-4e6d-8667-9aaa095de2fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:59.456891 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4d5dac2d-aca4-4e6d-8667-9aaa095de2fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:59.463495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d5dac2d-aca4-4e6d-8667-9aaa095de2fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:59.463979 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d5dac2d-aca4-4e6d-8667-9aaa095de2fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:59.464414 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d5dac2d-aca4-4e6d-8667-9aaa095de2fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:59.465107 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d5dac2d-aca4-4e6d-8667-9aaa095de2fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:59.465563 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d5dac2d-aca4-4e6d-8667-9aaa095de2fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:59.465986 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d5dac2d-aca4-4e6d-8667-9aaa095de2fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:59.466527 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6910a314-52ea-4ef2-8a1d-f3c66770200e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:59.467285 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6910a314-52ea-4ef2-8a1d-f3c66770200e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:59.474995 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6910a314-52ea-4ef2-8a1d-f3c66770200e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:59.475475 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6910a314-52ea-4ef2-8a1d-f3c66770200e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:59.475905 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6910a314-52ea-4ef2-8a1d-f3c66770200e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:59.476594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6910a314-52ea-4ef2-8a1d-f3c66770200e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:59.477042 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6910a314-52ea-4ef2-8a1d-f3c66770200e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:59.477468 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6910a314-52ea-4ef2-8a1d-f3c66770200e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:59.597206 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4d5dac2d-aca4-4e6d-8667-9aaa095de2fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:59.605433 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4d5dac2d-aca4-4e6d-8667-9aaa095de2fa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.153528 Aug 08 02:29:59.606188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 303/586] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:59 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:29:59.612567 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6910a314-52ea-4ef2-8a1d-f3c66770200e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:59.620007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6910a314-52ea-4ef2-8a1d-f3c66770200e tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.157845 Aug 08 02:29:59.620563 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 284/587] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:59 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:29:59.739554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d0301d95-d721-4967-9cae-bd699aec29b3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:29:59.740093 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d0301d95-d721-4967-9cae-bd699aec29b3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:29:59.750461 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0301d95-d721-4967-9cae-bd699aec29b3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:59.751185 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0301d95-d721-4967-9cae-bd699aec29b3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:59.751795 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0301d95-d721-4967-9cae-bd699aec29b3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:59.752597 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0301d95-d721-4967-9cae-bd699aec29b3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:29:59.753042 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0301d95-d721-4967-9cae-bd699aec29b3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:29:59.753459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0301d95-d721-4967-9cae-bd699aec29b3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:29:59.877417 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d0301d95-d721-4967-9cae-bd699aec29b3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:29:59.884752 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d0301d95-d721-4967-9cae-bd699aec29b3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.149008 Aug 08 02:29:59.885314 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 304/588] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:29:59 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:00.627020 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7c8fe116-b83c-4676-ad43-b92109d9f851 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:00.627623 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7c8fe116-b83c-4676-ad43-b92109d9f851 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:00.633977 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c8fe116-b83c-4676-ad43-b92109d9f851 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:00.634487 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c8fe116-b83c-4676-ad43-b92109d9f851 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:00.634915 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c8fe116-b83c-4676-ad43-b92109d9f851 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:00.635667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c8fe116-b83c-4676-ad43-b92109d9f851 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:00.636119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c8fe116-b83c-4676-ad43-b92109d9f851 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:00.636535 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c8fe116-b83c-4676-ad43-b92109d9f851 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:00.640335 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-461fe67e-c833-426f-9ff4-6fe0d4af9182 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:00.641491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-461fe67e-c833-426f-9ff4-6fe0d4af9182 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:00.647927 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-461fe67e-c833-426f-9ff4-6fe0d4af9182 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:00.648404 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-461fe67e-c833-426f-9ff4-6fe0d4af9182 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:00.648835 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-461fe67e-c833-426f-9ff4-6fe0d4af9182 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:00.649518 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-461fe67e-c833-426f-9ff4-6fe0d4af9182 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:00.649968 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-461fe67e-c833-426f-9ff4-6fe0d4af9182 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:00.650429 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-461fe67e-c833-426f-9ff4-6fe0d4af9182 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:00.766967 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7c8fe116-b83c-4676-ad43-b92109d9f851 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:00.775264 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7c8fe116-b83c-4676-ad43-b92109d9f851 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.152633 Aug 08 02:30:00.775852 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 285/589] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:00 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:00.781086 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-461fe67e-c833-426f-9ff4-6fe0d4af9182 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:00.788522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-461fe67e-c833-426f-9ff4-6fe0d4af9182 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.151948 Aug 08 02:30:00.789075 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 305/590] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:00 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:30:00.906674 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7070c070-f7a4-471b-94cc-7cc50eb8de75 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:00.907207 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7070c070-f7a4-471b-94cc-7cc50eb8de75 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:00.913345 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7070c070-f7a4-471b-94cc-7cc50eb8de75 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:00.913826 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7070c070-f7a4-471b-94cc-7cc50eb8de75 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:00.914273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7070c070-f7a4-471b-94cc-7cc50eb8de75 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:00.914979 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7070c070-f7a4-471b-94cc-7cc50eb8de75 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:00.915434 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7070c070-f7a4-471b-94cc-7cc50eb8de75 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:00.915851 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7070c070-f7a4-471b-94cc-7cc50eb8de75 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:01.050336 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7070c070-f7a4-471b-94cc-7cc50eb8de75 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:01.057866 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7070c070-f7a4-471b-94cc-7cc50eb8de75 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.155180 Aug 08 02:30:01.058494 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 286/591] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:00 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:01.796490 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f0a6ec9d-d746-47a8-a0a9-e2d7f98f3d2c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:01.797098 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f0a6ec9d-d746-47a8-a0a9-e2d7f98f3d2c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:01.803675 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f0a6ec9d-d746-47a8-a0a9-e2d7f98f3d2c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:01.804155 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f0a6ec9d-d746-47a8-a0a9-e2d7f98f3d2c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:01.804581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f0a6ec9d-d746-47a8-a0a9-e2d7f98f3d2c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:01.805263 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f0a6ec9d-d746-47a8-a0a9-e2d7f98f3d2c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:01.805714 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f0a6ec9d-d746-47a8-a0a9-e2d7f98f3d2c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:01.806131 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f0a6ec9d-d746-47a8-a0a9-e2d7f98f3d2c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:01.807658 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-abcc7ae8-f882-42c2-acb5-0d770bba55ed tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:01.808283 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-abcc7ae8-f882-42c2-acb5-0d770bba55ed tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:01.814895 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-abcc7ae8-f882-42c2-acb5-0d770bba55ed tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:01.815365 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-abcc7ae8-f882-42c2-acb5-0d770bba55ed tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:01.815792 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-abcc7ae8-f882-42c2-acb5-0d770bba55ed tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:01.816471 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-abcc7ae8-f882-42c2-acb5-0d770bba55ed tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:01.816919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-abcc7ae8-f882-42c2-acb5-0d770bba55ed tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:01.817337 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-abcc7ae8-f882-42c2-acb5-0d770bba55ed tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:01.946367 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f0a6ec9d-d746-47a8-a0a9-e2d7f98f3d2c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:01.950346 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-abcc7ae8-f882-42c2-acb5-0d770bba55ed tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:01.954874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f0a6ec9d-d746-47a8-a0a9-e2d7f98f3d2c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.162290 Aug 08 02:30:01.955440 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 306/592] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:01 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:01.958385 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-abcc7ae8-f882-42c2-acb5-0d770bba55ed tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.154512 Aug 08 02:30:01.958938 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 287/593] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:01 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:30:02.079886 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-04be3542-ff55-4d8a-95ce-c9be51bf0184 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:02.080419 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-04be3542-ff55-4d8a-95ce-c9be51bf0184 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:02.086353 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-04be3542-ff55-4d8a-95ce-c9be51bf0184 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:02.086833 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-04be3542-ff55-4d8a-95ce-c9be51bf0184 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:02.087264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-04be3542-ff55-4d8a-95ce-c9be51bf0184 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:02.087945 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-04be3542-ff55-4d8a-95ce-c9be51bf0184 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:02.088393 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-04be3542-ff55-4d8a-95ce-c9be51bf0184 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:02.088813 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-04be3542-ff55-4d8a-95ce-c9be51bf0184 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:02.228773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-04be3542-ff55-4d8a-95ce-c9be51bf0184 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:02.236604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-04be3542-ff55-4d8a-95ce-c9be51bf0184 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.161085 Aug 08 02:30:02.237182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 307/594] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:02 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:02.975958 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-11b501b4-55c0-467e-a5ae-676d744ac486 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:02.976580 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-11b501b4-55c0-467e-a5ae-676d744ac486 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:02.979026 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a87b2ed3-305e-479c-8553-509db9c96eaf tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:02.979665 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a87b2ed3-305e-479c-8553-509db9c96eaf tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:02.983049 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11b501b4-55c0-467e-a5ae-676d744ac486 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:02.983562 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11b501b4-55c0-467e-a5ae-676d744ac486 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:02.983998 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11b501b4-55c0-467e-a5ae-676d744ac486 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:02.985312 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11b501b4-55c0-467e-a5ae-676d744ac486 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:02.985773 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11b501b4-55c0-467e-a5ae-676d744ac486 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:02.986200 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11b501b4-55c0-467e-a5ae-676d744ac486 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:02.986702 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a87b2ed3-305e-479c-8553-509db9c96eaf tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:02.987167 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a87b2ed3-305e-479c-8553-509db9c96eaf tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:02.987589 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a87b2ed3-305e-479c-8553-509db9c96eaf tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:02.988262 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a87b2ed3-305e-479c-8553-509db9c96eaf tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:02.988707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a87b2ed3-305e-479c-8553-509db9c96eaf tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:02.989116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a87b2ed3-305e-479c-8553-509db9c96eaf tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:03.118096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-11b501b4-55c0-467e-a5ae-676d744ac486 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:03.120686 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a87b2ed3-305e-479c-8553-509db9c96eaf tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:03.124053 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:03.126420 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-11b501b4-55c0-467e-a5ae-676d744ac486 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.154279 Aug 08 02:30:03.126999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 288/595] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:02 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:03.128887 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a87b2ed3-305e-479c-8553-509db9c96eaf tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.153726 Aug 08 02:30:03.129445 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 308/596] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:02 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:30:03.258121 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7cc093b3-4cae-4ba9-9e62-26480fc7a322 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:03.258804 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7cc093b3-4cae-4ba9-9e62-26480fc7a322 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:03.264665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7cc093b3-4cae-4ba9-9e62-26480fc7a322 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:03.265137 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7cc093b3-4cae-4ba9-9e62-26480fc7a322 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:03.266064 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7cc093b3-4cae-4ba9-9e62-26480fc7a322 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:03.266787 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7cc093b3-4cae-4ba9-9e62-26480fc7a322 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:03.267235 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7cc093b3-4cae-4ba9-9e62-26480fc7a322 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:03.267684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7cc093b3-4cae-4ba9-9e62-26480fc7a322 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:03.397296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7cc093b3-4cae-4ba9-9e62-26480fc7a322 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:03.404738 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7cc093b3-4cae-4ba9-9e62-26480fc7a322 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.150500 Aug 08 02:30:03.405306 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 289/597] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:03 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:04.147297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-bfd963b8-6062-414d-8593-5b56014c06cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:04.147907 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-bfd963b8-6062-414d-8593-5b56014c06cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:04.148609 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e4a92378-25c9-4728-9bed-3fc79cccaf6d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:04.149226 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e4a92378-25c9-4728-9bed-3fc79cccaf6d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:04.155321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bfd963b8-6062-414d-8593-5b56014c06cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:04.155791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bfd963b8-6062-414d-8593-5b56014c06cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:04.155920 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4a92378-25c9-4728-9bed-3fc79cccaf6d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:04.156219 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bfd963b8-6062-414d-8593-5b56014c06cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:04.156346 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4a92378-25c9-4728-9bed-3fc79cccaf6d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:04.156729 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4a92378-25c9-4728-9bed-3fc79cccaf6d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:04.156897 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bfd963b8-6062-414d-8593-5b56014c06cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:04.157341 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bfd963b8-6062-414d-8593-5b56014c06cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:04.157443 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4a92378-25c9-4728-9bed-3fc79cccaf6d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:04.157773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bfd963b8-6062-414d-8593-5b56014c06cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:04.157869 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4a92378-25c9-4728-9bed-3fc79cccaf6d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:04.158270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4a92378-25c9-4728-9bed-3fc79cccaf6d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:04.288549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e4a92378-25c9-4728-9bed-3fc79cccaf6d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:04.291339 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-bfd963b8-6062-414d-8593-5b56014c06cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:04.296113 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e4a92378-25c9-4728-9bed-3fc79cccaf6d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.151281 Aug 08 02:30:04.296684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 290/598] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:04 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:30:04.299776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-bfd963b8-6062-414d-8593-5b56014c06cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.156904 Aug 08 02:30:04.300325 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 309/599] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:04 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:04.426849 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-975690ce-812a-4850-94b0-bd5ef5b71f3f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:04.427378 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-975690ce-812a-4850-94b0-bd5ef5b71f3f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:04.433206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-975690ce-812a-4850-94b0-bd5ef5b71f3f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:04.433680 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-975690ce-812a-4850-94b0-bd5ef5b71f3f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:04.434103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-975690ce-812a-4850-94b0-bd5ef5b71f3f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:04.434801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-975690ce-812a-4850-94b0-bd5ef5b71f3f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:04.435272 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-975690ce-812a-4850-94b0-bd5ef5b71f3f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:04.435686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-975690ce-812a-4850-94b0-bd5ef5b71f3f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:04.439524 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:04.569467 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-975690ce-812a-4850-94b0-bd5ef5b71f3f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:04.576980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-975690ce-812a-4850-94b0-bd5ef5b71f3f tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.154050 Aug 08 02:30:04.577557 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 291/600] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:04 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:05.318234 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d276cff5-aa61-419e-b01c-ce86fcb26f14 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:05.318863 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d276cff5-aa61-419e-b01c-ce86fcb26f14 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:05.320638 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c29bba60-80b7-4d18-a865-59078017ce05 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:05.321259 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c29bba60-80b7-4d18-a865-59078017ce05 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:05.325711 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d276cff5-aa61-419e-b01c-ce86fcb26f14 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:05.325823 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d276cff5-aa61-419e-b01c-ce86fcb26f14 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:05.326189 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d276cff5-aa61-419e-b01c-ce86fcb26f14 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:05.326869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d276cff5-aa61-419e-b01c-ce86fcb26f14 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:05.327318 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d276cff5-aa61-419e-b01c-ce86fcb26f14 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:05.327616 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c29bba60-80b7-4d18-a865-59078017ce05 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:05.327728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d276cff5-aa61-419e-b01c-ce86fcb26f14 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:05.328735 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c29bba60-80b7-4d18-a865-59078017ce05 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:05.329172 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c29bba60-80b7-4d18-a865-59078017ce05 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:05.329865 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c29bba60-80b7-4d18-a865-59078017ce05 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:05.330375 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c29bba60-80b7-4d18-a865-59078017ce05 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:05.330802 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c29bba60-80b7-4d18-a865-59078017ce05 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:05.459289 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c29bba60-80b7-4d18-a865-59078017ce05 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:05.459475 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d276cff5-aa61-419e-b01c-ce86fcb26f14 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:05.466862 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d276cff5-aa61-419e-b01c-ce86fcb26f14 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.152895 Aug 08 02:30:05.467331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c29bba60-80b7-4d18-a865-59078017ce05 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.150524 Aug 08 02:30:05.467452 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 310/601] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:05 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:05.467903 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 292/602] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:05 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:30:05.597949 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b3e2c4b8-0203-4a77-a166-5a60d00b93e7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:05.598578 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b3e2c4b8-0203-4a77-a166-5a60d00b93e7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:05.604412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b3e2c4b8-0203-4a77-a166-5a60d00b93e7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:05.604888 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b3e2c4b8-0203-4a77-a166-5a60d00b93e7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:05.605316 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b3e2c4b8-0203-4a77-a166-5a60d00b93e7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:05.605990 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b3e2c4b8-0203-4a77-a166-5a60d00b93e7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:05.606465 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b3e2c4b8-0203-4a77-a166-5a60d00b93e7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:05.606887 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b3e2c4b8-0203-4a77-a166-5a60d00b93e7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:05.730567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b3e2c4b8-0203-4a77-a166-5a60d00b93e7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:05.738586 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b3e2c4b8-0203-4a77-a166-5a60d00b93e7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.144372 Aug 08 02:30:05.739141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 311/603] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:05 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:06.487536 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ca3cbf7b-e60c-4c5b-a7f6-561d03126f80 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:06.488041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-97ff544e-b8ae-490e-8d6b-d9df1e087ef4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:06.488445 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ca3cbf7b-e60c-4c5b-a7f6-561d03126f80 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:06.488549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-97ff544e-b8ae-490e-8d6b-d9df1e087ef4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:06.494708 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-97ff544e-b8ae-490e-8d6b-d9df1e087ef4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:06.494857 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca3cbf7b-e60c-4c5b-a7f6-561d03126f80 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:06.495182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-97ff544e-b8ae-490e-8d6b-d9df1e087ef4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:06.495295 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca3cbf7b-e60c-4c5b-a7f6-561d03126f80 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:06.495608 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-97ff544e-b8ae-490e-8d6b-d9df1e087ef4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:06.495709 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca3cbf7b-e60c-4c5b-a7f6-561d03126f80 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:06.496287 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-97ff544e-b8ae-490e-8d6b-d9df1e087ef4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:06.496386 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca3cbf7b-e60c-4c5b-a7f6-561d03126f80 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:06.496773 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca3cbf7b-e60c-4c5b-a7f6-561d03126f80 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:06.496873 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-97ff544e-b8ae-490e-8d6b-d9df1e087ef4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:06.497196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca3cbf7b-e60c-4c5b-a7f6-561d03126f80 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:06.497294 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-97ff544e-b8ae-490e-8d6b-d9df1e087ef4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:06.631366 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ca3cbf7b-e60c-4c5b-a7f6-561d03126f80 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:06.631770 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-97ff544e-b8ae-490e-8d6b-d9df1e087ef4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:06.638988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ca3cbf7b-e60c-4c5b-a7f6-561d03126f80 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.155417 Aug 08 02:30:06.639874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-97ff544e-b8ae-490e-8d6b-d9df1e087ef4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.155675 Aug 08 02:30:06.640032 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 293/604] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:06 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:06.640470 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 312/605] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:06 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:30:06.759469 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-45e7eb76-bb15-4a99-964f-8c7e0bb64491 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:06.760098 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-45e7eb76-bb15-4a99-964f-8c7e0bb64491 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:06.766459 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45e7eb76-bb15-4a99-964f-8c7e0bb64491 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:06.766930 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45e7eb76-bb15-4a99-964f-8c7e0bb64491 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:06.767352 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45e7eb76-bb15-4a99-964f-8c7e0bb64491 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:06.768027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45e7eb76-bb15-4a99-964f-8c7e0bb64491 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:06.768468 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45e7eb76-bb15-4a99-964f-8c7e0bb64491 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:06.768889 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45e7eb76-bb15-4a99-964f-8c7e0bb64491 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:06.894700 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-45e7eb76-bb15-4a99-964f-8c7e0bb64491 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:06.902067 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-45e7eb76-bb15-4a99-964f-8c7e0bb64491 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.146285 Aug 08 02:30:06.902654 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 294/606] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:06 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:30:07.660683 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d084e677-34da-4e54-9c48-679517fda62a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:07.661355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-485194b6-77ec-4426-92e7-24ba4c5a6cdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:07.661738 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d084e677-34da-4e54-9c48-679517fda62a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:07.661971 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-485194b6-77ec-4426-92e7-24ba4c5a6cdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:07.668183 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-485194b6-77ec-4426-92e7-24ba4c5a6cdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:07.668298 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d084e677-34da-4e54-9c48-679517fda62a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:07.668589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-485194b6-77ec-4426-92e7-24ba4c5a6cdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:07.669040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-485194b6-77ec-4426-92e7-24ba4c5a6cdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:07.669161 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d084e677-34da-4e54-9c48-679517fda62a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:07.669701 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-485194b6-77ec-4426-92e7-24ba4c5a6cdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:07.669815 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d084e677-34da-4e54-9c48-679517fda62a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:07.670329 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-485194b6-77ec-4426-92e7-24ba4c5a6cdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:07.670602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-485194b6-77ec-4426-92e7-24ba4c5a6cdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:07.670917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d084e677-34da-4e54-9c48-679517fda62a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:07.671456 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d084e677-34da-4e54-9c48-679517fda62a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:07.672058 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d084e677-34da-4e54-9c48-679517fda62a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:07.826127 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d084e677-34da-4e54-9c48-679517fda62a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:07.834365 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d084e677-34da-4e54-9c48-679517fda62a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.178066 Aug 08 02:30:07.834939 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 313/607] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:07 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:07.841786 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-485194b6-77ec-4426-92e7-24ba4c5a6cdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:07.851564 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-485194b6-77ec-4426-92e7-24ba4c5a6cdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1722 microversion: 2.1 time: 0.193758 Aug 08 02:30:07.854637 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 295/608] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:07 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:30:07.926880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-586bcb16-9693-4db7-8774-f2306e9429d0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:07.927501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-586bcb16-9693-4db7-8774-f2306e9429d0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:07.934119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-586bcb16-9693-4db7-8774-f2306e9429d0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:07.934709 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-586bcb16-9693-4db7-8774-f2306e9429d0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:07.935153 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-586bcb16-9693-4db7-8774-f2306e9429d0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:07.935780 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-586bcb16-9693-4db7-8774-f2306e9429d0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:07.936466 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-586bcb16-9693-4db7-8774-f2306e9429d0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:07.936828 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-586bcb16-9693-4db7-8774-f2306e9429d0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:08.475614 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-586bcb16-9693-4db7-8774-f2306e9429d0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:08.483991 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-586bcb16-9693-4db7-8774-f2306e9429d0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 200 len: 1514 microversion: 2.1 time: 0.565548 Aug 08 02:30:08.485065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 314/609] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:07 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 1514 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:08.760433 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-d67c121f-c539-4edf-8541-b1ad890fa032 req-a3a78bb5-4f0a-4e55-94b7-0438baad34e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ea1a9c-fd55-4d21-909a-235e4422e6d6", "name": "network-vif-deleted", "tag": "eac6eba0-4fcb-45b9-8708-de73198d3388"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:30:08.771479 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d67c121f-c539-4edf-8541-b1ad890fa032 req-a3a78bb5-4f0a-4e55-94b7-0438baad34e4 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:08.771957 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d67c121f-c539-4edf-8541-b1ad890fa032 req-a3a78bb5-4f0a-4e55-94b7-0438baad34e4 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:08.772383 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d67c121f-c539-4edf-8541-b1ad890fa032 req-a3a78bb5-4f0a-4e55-94b7-0438baad34e4 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:08.785143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-d67c121f-c539-4edf-8541-b1ad890fa032 req-a3a78bb5-4f0a-4e55-94b7-0438baad34e4 service nova] Creating event network-vif-deleted:eac6eba0-4fcb-45b9-8708-de73198d3388 for instance f1ea1a9c-fd55-4d21-909a-235e4422e6d6 on hv-cinder-73306 Aug 08 02:30:08.790653 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-d67c121f-c539-4edf-8541-b1ad890fa032 req-a3a78bb5-4f0a-4e55-94b7-0438baad34e4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034063 Aug 08 02:30:08.791560 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 296/610] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:30:08.857224 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-714d1462-a4ad-4d4f-b9ba-c0f44576a8ba tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:08.857930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-714d1462-a4ad-4d4f-b9ba-c0f44576a8ba tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:08.869610 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-714d1462-a4ad-4d4f-b9ba-c0f44576a8ba tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:08.874041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-510e3fbf-239d-447d-9dab-cf24198600ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:08.875007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-510e3fbf-239d-447d-9dab-cf24198600ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:08.877108 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-714d1462-a4ad-4d4f-b9ba-c0f44576a8ba tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:08.879116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-714d1462-a4ad-4d4f-b9ba-c0f44576a8ba tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:08.880866 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-714d1462-a4ad-4d4f-b9ba-c0f44576a8ba tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:08.881401 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-510e3fbf-239d-447d-9dab-cf24198600ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:08.881890 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-510e3fbf-239d-447d-9dab-cf24198600ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:08.882398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-714d1462-a4ad-4d4f-b9ba-c0f44576a8ba tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:08.882518 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-510e3fbf-239d-447d-9dab-cf24198600ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:08.883173 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-510e3fbf-239d-447d-9dab-cf24198600ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:08.883780 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-714d1462-a4ad-4d4f-b9ba-c0f44576a8ba tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:08.883925 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-510e3fbf-239d-447d-9dab-cf24198600ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:08.884212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-510e3fbf-239d-447d-9dab-cf24198600ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:09.038672 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-510e3fbf-239d-447d-9dab-cf24198600ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:09.041253 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-714d1462-a4ad-4d4f-b9ba-c0f44576a8ba tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:09.047510 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-510e3fbf-239d-447d-9dab-cf24198600ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1699 microversion: 2.1 time: 0.177629 Aug 08 02:30:09.048114 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 297/611] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:08 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1699 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:30:09.049811 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-714d1462-a4ad-4d4f-b9ba-c0f44576a8ba tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1368 microversion: 2.1 time: 0.198321 Aug 08 02:30:09.050421 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 315/612] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:08 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:09.068707 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2d0195f3-0295-4175-914d-839dd30b37f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:30:09.075522 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d0195f3-0295-4175-914d-839dd30b37f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:09.076012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d0195f3-0295-4175-914d-839dd30b37f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:09.076427 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d0195f3-0295-4175-914d-839dd30b37f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:09.098957 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2d0195f3-0295-4175-914d-839dd30b37f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Going to try to start instance {{(pid=117642) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 02:30:09.138272 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2d0195f3-0295-4175-914d-839dd30b37f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "POST /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/action" status: 202 len: 0 microversion: 2.1 time: 0.073382 Aug 08 02:30:09.138826 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 298/613] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:30:09 2022] POST /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:30:09.147454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-504dcdfe-a4c3-4adc-a236-c287f07c1c10 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:09.148065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-504dcdfe-a4c3-4adc-a236-c287f07c1c10 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:09.153964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-504dcdfe-a4c3-4adc-a236-c287f07c1c10 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:09.154476 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-504dcdfe-a4c3-4adc-a236-c287f07c1c10 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:09.154909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-504dcdfe-a4c3-4adc-a236-c287f07c1c10 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:09.155615 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-504dcdfe-a4c3-4adc-a236-c287f07c1c10 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:09.156124 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-504dcdfe-a4c3-4adc-a236-c287f07c1c10 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:09.157085 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-504dcdfe-a4c3-4adc-a236-c287f07c1c10 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:09.290596 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-504dcdfe-a4c3-4adc-a236-c287f07c1c10 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:09.298707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-504dcdfe-a4c3-4adc-a236-c287f07c1c10 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1708 microversion: 2.1 time: 0.155181 Aug 08 02:30:09.299274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 316/614] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:09 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:09.505999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3d787ea5-2665-4090-82d6-5bffdb2d228a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:09.506735 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3d787ea5-2665-4090-82d6-5bffdb2d228a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: f1ea1a9c-fd55-4d21-909a-235e4422e6d6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:09.513706 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3d787ea5-2665-4090-82d6-5bffdb2d228a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:09.518574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3d787ea5-2665-4090-82d6-5bffdb2d228a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:09.519051 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3d787ea5-2665-4090-82d6-5bffdb2d228a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:09.519783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3d787ea5-2665-4090-82d6-5bffdb2d228a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:09.520251 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3d787ea5-2665-4090-82d6-5bffdb2d228a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:09.520770 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3d787ea5-2665-4090-82d6-5bffdb2d228a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:09.544264 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-3d787ea5-2665-4090-82d6-5bffdb2d228a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] HTTP exception thrown: Instance f1ea1a9c-fd55-4d21-909a-235e4422e6d6 could not be found. Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3d787ea5-2665-4090-82d6-5bffdb2d228a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Request method failure captured: Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 HTTP/1.1 Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HSpP-k-12ExRlrFMh7KEkIWtAm-63OSTCSn4XY4-Qk_AKJaDd_utJ6tgw2pycV10y896o5o9SIQN6FHA4LqcbmNqfg5gCsHC1eFprsLIvrmFF0u3Q1aviY7KvVmkM6QxiGDqcJq8Wwa0IldsmYXIBlnnIyo5fFYLFG5UCmX7vtxpLU Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 2d75f4c0fe9148e7bf633a79dbfd6bb9 Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1411467720 Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:30:09.545931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:30:09.548178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2d75f4c0fe9148e7bf633a79dbfd6bb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d75f4c0fe9148e7bf633a79dbfd6bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2d75f4c0fe9148e7bf633a79dbfd6bb9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d75f4c0fe9148e7bf633a79dbfd6bb9"}]}] Aug 08 02:30:09.548178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotTestJSON-1411467720 Aug 08 02:30:09.548178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 2d75f4c0fe9148e7bf633a79dbfd6bb9 Aug 08 02:30:09.548178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1411467720 Aug 08 02:30:09.548178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotTestJSON-1411467720-project Aug 08 02:30:09.548178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:30:09.548178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:30:09.548178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: ef2ca1a30a76468cbe02b20efd6ca37e Aug 08 02:30:09.548178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotTestJSON-1411467720-project Aug 08 02:30:09.548178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:30:09.548178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance f1ea1a9c-fd55-4d21-909a-235e4422e6d6 could not be found. Aug 08 02:30:09.548178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': 'f1ea1a9c-fd55-4d21-909a-235e4422e6d6'} Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ea1a9c-fd55-4d21-909a-235e4422e6d6 could not be found. Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:30:09.549201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ea1a9c-fd55-4d21-909a-235e4422e6d6 could not be found. Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ea1a9c-fd55-4d21-909a-235e4422e6d6 could not be found. Aug 08 02:30:09.550878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:30:09.553255 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3d787ea5-2665-4090-82d6-5bffdb2d228a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Returning 404 to user: Instance f1ea1a9c-fd55-4d21-909a-235e4422e6d6 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:30:09.554287 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3d787ea5-2665-4090-82d6-5bffdb2d228a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6" status: 404 len: 111 microversion: 2.1 time: 0.049992 Aug 08 02:30:09.563482 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 299/615] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:09 2022] GET /compute/v2.1/servers/f1ea1a9c-fd55-4d21-909a-235e4422e6d6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:30:10.072806 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-25f676a9-20c7-4ca4-b53b-31d88d9fb441 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:10.073422 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-25f676a9-20c7-4ca4-b53b-31d88d9fb441 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:10.080234 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-25f676a9-20c7-4ca4-b53b-31d88d9fb441 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:10.080714 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-25f676a9-20c7-4ca4-b53b-31d88d9fb441 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:10.081146 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-25f676a9-20c7-4ca4-b53b-31d88d9fb441 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:10.082498 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-25f676a9-20c7-4ca4-b53b-31d88d9fb441 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:10.082956 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-25f676a9-20c7-4ca4-b53b-31d88d9fb441 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:10.083725 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-25f676a9-20c7-4ca4-b53b-31d88d9fb441 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:10.218988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-25f676a9-20c7-4ca4-b53b-31d88d9fb441 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:10.226352 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-25f676a9-20c7-4ca4-b53b-31d88d9fb441 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1559 microversion: 2.1 time: 0.158889 Aug 08 02:30:10.226922 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 317/616] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:10 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:10.246622 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b5f11fa0-8b66-41de-b3e9-4dfb02715cb0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:10.247112 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b5f11fa0-8b66-41de-b3e9-4dfb02715cb0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:10.253804 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b5f11fa0-8b66-41de-b3e9-4dfb02715cb0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:10.254317 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b5f11fa0-8b66-41de-b3e9-4dfb02715cb0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:10.254739 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b5f11fa0-8b66-41de-b3e9-4dfb02715cb0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:10.255418 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b5f11fa0-8b66-41de-b3e9-4dfb02715cb0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:10.255865 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b5f11fa0-8b66-41de-b3e9-4dfb02715cb0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:10.256279 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b5f11fa0-8b66-41de-b3e9-4dfb02715cb0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:10.320269 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b232c12d-3375-473f-8e8e-f2adcbe64967 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:10.321003 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b232c12d-3375-473f-8e8e-f2adcbe64967 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:10.326985 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b232c12d-3375-473f-8e8e-f2adcbe64967 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:10.327539 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b232c12d-3375-473f-8e8e-f2adcbe64967 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:10.328042 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b232c12d-3375-473f-8e8e-f2adcbe64967 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:10.328799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b232c12d-3375-473f-8e8e-f2adcbe64967 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:10.329748 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b232c12d-3375-473f-8e8e-f2adcbe64967 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:10.329888 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b232c12d-3375-473f-8e8e-f2adcbe64967 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:10.332754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b5f11fa0-8b66-41de-b3e9-4dfb02715cb0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089890 Aug 08 02:30:10.333344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 300/617] 10.222.0.39 () {58 vars in 1275 bytes} [Mon Aug 8 02:30:10 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:30:10.461157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b232c12d-3375-473f-8e8e-f2adcbe64967 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:10.469683 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b232c12d-3375-473f-8e8e-f2adcbe64967 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1708 microversion: 2.1 time: 0.153286 Aug 08 02:30:10.470169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 318/618] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:10 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:11.262454 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-266ffcb9-1c7d-4f0f-ab38-aa540916557e req-8e220cba-12c9-440c-9e81-a72f59361ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "618e3559-1b3a-43a9-aede-202dbd418c4d", "tag": "4c1d8531-ad0b-4d95-b972-a3fde8050eea"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:30:11.272843 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-266ffcb9-1c7d-4f0f-ab38-aa540916557e req-8e220cba-12c9-440c-9e81-a72f59361ac8 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:11.273312 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-266ffcb9-1c7d-4f0f-ab38-aa540916557e req-8e220cba-12c9-440c-9e81-a72f59361ac8 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:11.273736 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-266ffcb9-1c7d-4f0f-ab38-aa540916557e req-8e220cba-12c9-440c-9e81-a72f59361ac8 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:11.284748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-266ffcb9-1c7d-4f0f-ab38-aa540916557e req-8e220cba-12c9-440c-9e81-a72f59361ac8 service nova] Creating event network-changed:4c1d8531-ad0b-4d95-b972-a3fde8050eea for instance 618e3559-1b3a-43a9-aede-202dbd418c4d on hv-cinder-73306 Aug 08 02:30:11.289766 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-266ffcb9-1c7d-4f0f-ab38-aa540916557e req-8e220cba-12c9-440c-9e81-a72f59361ac8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031671 Aug 08 02:30:11.290644 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 301/619] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:30:11.490579 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5c161c1c-8991-4e02-ac99-fbfcfd746051 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:11.491182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5c161c1c-8991-4e02-ac99-fbfcfd746051 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:11.497791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5c161c1c-8991-4e02-ac99-fbfcfd746051 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:11.498301 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5c161c1c-8991-4e02-ac99-fbfcfd746051 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:11.498744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5c161c1c-8991-4e02-ac99-fbfcfd746051 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:11.499419 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5c161c1c-8991-4e02-ac99-fbfcfd746051 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:11.500423 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5c161c1c-8991-4e02-ac99-fbfcfd746051 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:11.500841 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5c161c1c-8991-4e02-ac99-fbfcfd746051 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:11.630663 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5c161c1c-8991-4e02-ac99-fbfcfd746051 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:11.638563 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5c161c1c-8991-4e02-ac99-fbfcfd746051 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1708 microversion: 2.1 time: 0.151761 Aug 08 02:30:11.639130 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 319/620] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:11 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:12.660035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-15d6556a-da87-43cb-87de-a2cc678290c6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:12.660737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-15d6556a-da87-43cb-87de-a2cc678290c6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:12.666895 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15d6556a-da87-43cb-87de-a2cc678290c6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:12.667372 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15d6556a-da87-43cb-87de-a2cc678290c6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:12.667801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15d6556a-da87-43cb-87de-a2cc678290c6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:12.668481 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15d6556a-da87-43cb-87de-a2cc678290c6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:12.668929 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15d6556a-da87-43cb-87de-a2cc678290c6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:12.669352 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15d6556a-da87-43cb-87de-a2cc678290c6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:12.797644 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-15d6556a-da87-43cb-87de-a2cc678290c6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:12.805998 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-15d6556a-da87-43cb-87de-a2cc678290c6 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1708 microversion: 2.1 time: 0.150004 Aug 08 02:30:12.806602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 302/621] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:12 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:13.827263 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-14a8103d-be51-4889-8bce-afbe54a492aa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:13.828938 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-14a8103d-be51-4889-8bce-afbe54a492aa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:13.835787 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-14a8103d-be51-4889-8bce-afbe54a492aa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:13.836261 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-14a8103d-be51-4889-8bce-afbe54a492aa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:13.836702 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-14a8103d-be51-4889-8bce-afbe54a492aa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:13.837443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-14a8103d-be51-4889-8bce-afbe54a492aa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:13.837788 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-14a8103d-be51-4889-8bce-afbe54a492aa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:13.839368 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-14a8103d-be51-4889-8bce-afbe54a492aa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:13.978878 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-14a8103d-be51-4889-8bce-afbe54a492aa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:13.987343 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-14a8103d-be51-4889-8bce-afbe54a492aa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1708 microversion: 2.1 time: 0.164364 Aug 08 02:30:13.990343 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 320/622] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:13 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:15.009107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1bddb843-0bea-47c9-94d0-0e95b4752711 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:15.009810 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1bddb843-0bea-47c9-94d0-0e95b4752711 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:15.016878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1bddb843-0bea-47c9-94d0-0e95b4752711 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:15.017357 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1bddb843-0bea-47c9-94d0-0e95b4752711 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:15.017788 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1bddb843-0bea-47c9-94d0-0e95b4752711 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:15.018499 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1bddb843-0bea-47c9-94d0-0e95b4752711 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:15.018951 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1bddb843-0bea-47c9-94d0-0e95b4752711 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:15.019397 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1bddb843-0bea-47c9-94d0-0e95b4752711 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:15.152164 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1bddb843-0bea-47c9-94d0-0e95b4752711 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:15.160156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1bddb843-0bea-47c9-94d0-0e95b4752711 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1708 microversion: 2.1 time: 0.155190 Aug 08 02:30:15.160726 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 303/623] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:15 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:16.180946 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fd55e471-f963-4fc1-9a10-cda167adf79b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:16.181959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-fd55e471-f963-4fc1-9a10-cda167adf79b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:16.189412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fd55e471-f963-4fc1-9a10-cda167adf79b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:16.190155 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fd55e471-f963-4fc1-9a10-cda167adf79b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:16.190732 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fd55e471-f963-4fc1-9a10-cda167adf79b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:16.191429 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fd55e471-f963-4fc1-9a10-cda167adf79b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:16.191891 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fd55e471-f963-4fc1-9a10-cda167adf79b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:16.192315 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fd55e471-f963-4fc1-9a10-cda167adf79b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:16.334673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-fd55e471-f963-4fc1-9a10-cda167adf79b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:16.343654 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fd55e471-f963-4fc1-9a10-cda167adf79b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1712 microversion: 2.1 time: 0.166637 Aug 08 02:30:16.344230 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 321/624] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:16 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1712 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:22.637418 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-315570256", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "networks": [{"uuid": "86ef2667-12f4-45f7-a1d6-3a60b9ae0cb9"}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:30:22.689877 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] validate_networks() for [('86ef2667-12f4-45f7-a1d6-3a60b9ae0cb9', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:30:23.042024 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:30:23.042535 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:30:23.043231 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:30:23.043705 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:30:23.044186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:30:23.053445 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:23.053922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:23.054387 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:23.055109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:23.055727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:23.056150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:23.074212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Getting quotas for project 2d75f4c0fe9148e7bf633a79dbfd6bb9. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:30:23.078752 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Getting quotas for user ef2ca1a30a76468cbe02b20efd6ca37e and project 2d75f4c0fe9148e7bf633a79dbfd6bb9. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:30:23.089741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:30:23.092076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:30:23.136185 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1ace1476-0929-4069-bce8-29ed2069f7d7 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502354 Aug 08 02:30:23.143221 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 304/625] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:30:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:30:23.151816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b86c7110-257e-425e-b7b7-cf4c6ff10c42 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:23.152622 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b86c7110-257e-425e-b7b7-cf4c6ff10c42 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:23.238224 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b86c7110-257e-425e-b7b7-cf4c6ff10c42 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:23.246208 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b86c7110-257e-425e-b7b7-cf4c6ff10c42 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1218 microversion: 2.1 time: 0.100964 Aug 08 02:30:23.260865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 322/626] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:23 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:24.272382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-77be8082-a745-465e-aefd-2c0a7305c447 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:24.272995 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-77be8082-a745-465e-aefd-2c0a7305c447 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:24.282884 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77be8082-a745-465e-aefd-2c0a7305c447 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:24.282884 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77be8082-a745-465e-aefd-2c0a7305c447 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:24.282884 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77be8082-a745-465e-aefd-2c0a7305c447 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:24.282884 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77be8082-a745-465e-aefd-2c0a7305c447 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:24.283268 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77be8082-a745-465e-aefd-2c0a7305c447 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:24.283268 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-77be8082-a745-465e-aefd-2c0a7305c447 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:24.342444 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-77be8082-a745-465e-aefd-2c0a7305c447 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:24.350348 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-77be8082-a745-465e-aefd-2c0a7305c447 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1214 microversion: 2.1 time: 0.082271 Aug 08 02:30:24.350909 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 305/627] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:24 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:25.370648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e197ac97-895b-4eeb-9012-d6e5488dc893 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:25.371291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e197ac97-895b-4eeb-9012-d6e5488dc893 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:25.377697 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e197ac97-895b-4eeb-9012-d6e5488dc893 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:25.378168 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e197ac97-895b-4eeb-9012-d6e5488dc893 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:25.378625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e197ac97-895b-4eeb-9012-d6e5488dc893 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:25.379296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e197ac97-895b-4eeb-9012-d6e5488dc893 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:25.380043 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e197ac97-895b-4eeb-9012-d6e5488dc893 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:25.380463 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e197ac97-895b-4eeb-9012-d6e5488dc893 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:25.443577 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e197ac97-895b-4eeb-9012-d6e5488dc893 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:25.451055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e197ac97-895b-4eeb-9012-d6e5488dc893 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1214 microversion: 2.1 time: 0.084144 Aug 08 02:30:25.451618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 323/628] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:25 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:26.471355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e958a857-0b9c-4329-b551-838b0eaf081d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:26.471991 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e958a857-0b9c-4329-b551-838b0eaf081d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:26.478393 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e958a857-0b9c-4329-b551-838b0eaf081d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:26.478868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e958a857-0b9c-4329-b551-838b0eaf081d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:26.479302 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e958a857-0b9c-4329-b551-838b0eaf081d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:26.479985 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e958a857-0b9c-4329-b551-838b0eaf081d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:26.480434 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e958a857-0b9c-4329-b551-838b0eaf081d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:26.480854 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e958a857-0b9c-4329-b551-838b0eaf081d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:26.697935 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e958a857-0b9c-4329-b551-838b0eaf081d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:26.705615 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e958a857-0b9c-4329-b551-838b0eaf081d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1214 microversion: 2.1 time: 0.238131 Aug 08 02:30:26.706181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 306/629] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:26 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1214 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:27.726715 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-285193ce-d3d1-4447-8c21-09008b6866c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:27.727257 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-285193ce-d3d1-4447-8c21-09008b6866c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:27.733583 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-285193ce-d3d1-4447-8c21-09008b6866c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:27.734054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-285193ce-d3d1-4447-8c21-09008b6866c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:27.734509 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-285193ce-d3d1-4447-8c21-09008b6866c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:27.735179 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-285193ce-d3d1-4447-8c21-09008b6866c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:27.735620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-285193ce-d3d1-4447-8c21-09008b6866c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:27.736034 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-285193ce-d3d1-4447-8c21-09008b6866c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:27.849193 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-285193ce-d3d1-4447-8c21-09008b6866c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:27.856923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-285193ce-d3d1-4447-8c21-09008b6866c3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1270 microversion: 2.1 time: 0.134076 Aug 08 02:30:27.857834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 324/630] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:27 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:28.877710 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-54f50474-b7ca-4a8c-9941-06a10b9a8e8d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:28.878426 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-54f50474-b7ca-4a8c-9941-06a10b9a8e8d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:28.880974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:28.887678 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54f50474-b7ca-4a8c-9941-06a10b9a8e8d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:28.888241 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54f50474-b7ca-4a8c-9941-06a10b9a8e8d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:28.888739 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54f50474-b7ca-4a8c-9941-06a10b9a8e8d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:28.889500 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54f50474-b7ca-4a8c-9941-06a10b9a8e8d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:28.890018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54f50474-b7ca-4a8c-9941-06a10b9a8e8d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:28.890530 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-54f50474-b7ca-4a8c-9941-06a10b9a8e8d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:29.023481 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-54f50474-b7ca-4a8c-9941-06a10b9a8e8d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:29.030955 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-54f50474-b7ca-4a8c-9941-06a10b9a8e8d tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1318 microversion: 2.1 time: 0.157333 Aug 08 02:30:29.031563 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 307/631] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:28 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:29.579421 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-6a0d3c62-8788-4bfb-8b0b-ae75d910d805 req-e14f69c8-3e31-4417-affe-2abb681bcc03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562ec29d-9b72-4bd5-acb6-947fa74a726d", "tag": "ccb8ae79-03bc-481f-8f1f-c20fdda89fc0"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:30:29.590204 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=48 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:29.592485 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-6a0d3c62-8788-4bfb-8b0b-ae75d910d805 req-e14f69c8-3e31-4417-affe-2abb681bcc03 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:29.593974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-6a0d3c62-8788-4bfb-8b0b-ae75d910d805 req-e14f69c8-3e31-4417-affe-2abb681bcc03 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:29.593974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-6a0d3c62-8788-4bfb-8b0b-ae75d910d805 req-e14f69c8-3e31-4417-affe-2abb681bcc03 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:29.609315 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-6a0d3c62-8788-4bfb-8b0b-ae75d910d805 req-e14f69c8-3e31-4417-affe-2abb681bcc03 service nova] Creating event network-changed:ccb8ae79-03bc-481f-8f1f-c20fdda89fc0 for instance 562ec29d-9b72-4bd5-acb6-947fa74a726d on hv-cinder-73306 Aug 08 02:30:29.615515 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-6a0d3c62-8788-4bfb-8b0b-ae75d910d805 req-e14f69c8-3e31-4417-affe-2abb681bcc03 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041072 Aug 08 02:30:29.616621 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 325/632] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:30:30.053246 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0c430339-83f4-4fb4-a597-73be0228778c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:30.054021 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0c430339-83f4-4fb4-a597-73be0228778c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:30.060362 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c430339-83f4-4fb4-a597-73be0228778c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:30.060913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c430339-83f4-4fb4-a597-73be0228778c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:30.061409 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c430339-83f4-4fb4-a597-73be0228778c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:30.062161 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c430339-83f4-4fb4-a597-73be0228778c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:30.062759 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c430339-83f4-4fb4-a597-73be0228778c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:30.063247 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c430339-83f4-4fb4-a597-73be0228778c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:30.216432 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0c430339-83f4-4fb4-a597-73be0228778c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:30.227374 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0c430339-83f4-4fb4-a597-73be0228778c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1318 microversion: 2.1 time: 0.177962 Aug 08 02:30:30.228273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 308/633] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:30 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:31.249043 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c47f79f8-dfeb-43c4-836d-b77e81c7d301 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:31.249729 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c47f79f8-dfeb-43c4-836d-b77e81c7d301 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:31.255892 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c47f79f8-dfeb-43c4-836d-b77e81c7d301 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:31.256271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c47f79f8-dfeb-43c4-836d-b77e81c7d301 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:31.256724 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c47f79f8-dfeb-43c4-836d-b77e81c7d301 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:31.257402 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c47f79f8-dfeb-43c4-836d-b77e81c7d301 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:31.257929 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c47f79f8-dfeb-43c4-836d-b77e81c7d301 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:31.258296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c47f79f8-dfeb-43c4-836d-b77e81c7d301 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:31.389911 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c47f79f8-dfeb-43c4-836d-b77e81c7d301 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:31.398673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c47f79f8-dfeb-43c4-836d-b77e81c7d301 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1318 microversion: 2.1 time: 0.154164 Aug 08 02:30:31.399248 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 326/634] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:31 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:32.424253 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9a1d649f-c85d-434f-ab47-b32f3ba903e0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:32.425003 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9a1d649f-c85d-434f-ab47-b32f3ba903e0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:32.436235 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a1d649f-c85d-434f-ab47-b32f3ba903e0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:32.437118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a1d649f-c85d-434f-ab47-b32f3ba903e0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:32.438232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a1d649f-c85d-434f-ab47-b32f3ba903e0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:32.440221 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a1d649f-c85d-434f-ab47-b32f3ba903e0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:32.442884 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a1d649f-c85d-434f-ab47-b32f3ba903e0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:32.443459 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a1d649f-c85d-434f-ab47-b32f3ba903e0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:32.868826 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9a1d649f-c85d-434f-ab47-b32f3ba903e0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:32.876702 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:32.880116 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9a1d649f-c85d-434f-ab47-b32f3ba903e0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1318 microversion: 2.1 time: 0.464067 Aug 08 02:30:32.881673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 309/635] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:32 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:33.905781 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-064c9588-b94e-423d-b757-3531ddcd0a0b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:33.907055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-064c9588-b94e-423d-b757-3531ddcd0a0b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:33.913395 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:33.915714 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-064c9588-b94e-423d-b757-3531ddcd0a0b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:33.916511 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-064c9588-b94e-423d-b757-3531ddcd0a0b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:33.917987 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-064c9588-b94e-423d-b757-3531ddcd0a0b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:33.917987 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-064c9588-b94e-423d-b757-3531ddcd0a0b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:33.918313 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-064c9588-b94e-423d-b757-3531ddcd0a0b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:33.918906 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-064c9588-b94e-423d-b757-3531ddcd0a0b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:33.954647 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:34.391387 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-064c9588-b94e-423d-b757-3531ddcd0a0b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:34.399779 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-064c9588-b94e-423d-b757-3531ddcd0a0b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1318 microversion: 2.1 time: 0.498535 Aug 08 02:30:34.412857 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 327/636] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:33 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:35.432943 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5cfaf2e8-e5e0-4c5d-8d95-c0ef095be8a0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:35.436574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5cfaf2e8-e5e0-4c5d-8d95-c0ef095be8a0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:35.452597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:35.453980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:35.456918 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cfaf2e8-e5e0-4c5d-8d95-c0ef095be8a0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:35.457782 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cfaf2e8-e5e0-4c5d-8d95-c0ef095be8a0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:35.458849 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cfaf2e8-e5e0-4c5d-8d95-c0ef095be8a0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:35.459888 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cfaf2e8-e5e0-4c5d-8d95-c0ef095be8a0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:35.461008 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cfaf2e8-e5e0-4c5d-8d95-c0ef095be8a0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:35.461654 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cfaf2e8-e5e0-4c5d-8d95-c0ef095be8a0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:35.695102 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5cfaf2e8-e5e0-4c5d-8d95-c0ef095be8a0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:35.707501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5cfaf2e8-e5e0-4c5d-8d95-c0ef095be8a0 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1318 microversion: 2.1 time: 0.283390 Aug 08 02:30:35.709213 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 310/637] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:35 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:36.739082 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fc819ee4-af9c-464b-9671-6381f0372e56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:36.739770 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-fc819ee4-af9c-464b-9671-6381f0372e56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:36.756732 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fc819ee4-af9c-464b-9671-6381f0372e56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:36.757212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fc819ee4-af9c-464b-9671-6381f0372e56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:36.757838 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fc819ee4-af9c-464b-9671-6381f0372e56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:36.758738 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fc819ee4-af9c-464b-9671-6381f0372e56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:36.759636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fc819ee4-af9c-464b-9671-6381f0372e56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:36.760206 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fc819ee4-af9c-464b-9671-6381f0372e56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:36.989176 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-fc819ee4-af9c-464b-9671-6381f0372e56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:37.006312 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fc819ee4-af9c-464b-9671-6381f0372e56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1318 microversion: 2.1 time: 0.277109 Aug 08 02:30:37.009226 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 328/638] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:36 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:37.189232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-99b3eb31-d718-4a2f-930f-1446720c3ed8 req-425e2841-8575-4002-bf64-209f74ac471f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562ec29d-9b72-4bd5-acb6-947fa74a726d", "name": "network-vif-plugged", "status": "completed", "tag": "ccb8ae79-03bc-481f-8f1f-c20fdda89fc0"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:30:37.215695 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-99b3eb31-d718-4a2f-930f-1446720c3ed8 req-425e2841-8575-4002-bf64-209f74ac471f service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:37.216181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-99b3eb31-d718-4a2f-930f-1446720c3ed8 req-425e2841-8575-4002-bf64-209f74ac471f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:37.216615 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-99b3eb31-d718-4a2f-930f-1446720c3ed8 req-425e2841-8575-4002-bf64-209f74ac471f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:37.245117 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-99b3eb31-d718-4a2f-930f-1446720c3ed8 req-425e2841-8575-4002-bf64-209f74ac471f service nova] Creating event network-vif-plugged:ccb8ae79-03bc-481f-8f1f-c20fdda89fc0 for instance 562ec29d-9b72-4bd5-acb6-947fa74a726d on hv-cinder-73306 Aug 08 02:30:37.254283 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-99b3eb31-d718-4a2f-930f-1446720c3ed8 req-425e2841-8575-4002-bf64-209f74ac471f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070777 Aug 08 02:30:37.255575 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 311/639] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:30:38.035951 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-19d8b3d4-3f32-4d2a-b4c1-562c6e4bea86 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:38.037932 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-19d8b3d4-3f32-4d2a-b4c1-562c6e4bea86 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:38.052242 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-19d8b3d4-3f32-4d2a-b4c1-562c6e4bea86 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:38.053915 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-19d8b3d4-3f32-4d2a-b4c1-562c6e4bea86 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:38.054588 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-19d8b3d4-3f32-4d2a-b4c1-562c6e4bea86 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:38.055544 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-19d8b3d4-3f32-4d2a-b4c1-562c6e4bea86 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:38.057133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-19d8b3d4-3f32-4d2a-b4c1-562c6e4bea86 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:38.058392 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-19d8b3d4-3f32-4d2a-b4c1-562c6e4bea86 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:38.263035 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-19d8b3d4-3f32-4d2a-b4c1-562c6e4bea86 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:38.276144 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-19d8b3d4-3f32-4d2a-b4c1-562c6e4bea86 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1318 microversion: 2.1 time: 0.245883 Aug 08 02:30:38.282786 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 329/640] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:38 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:39.308003 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e4384fae-a1f7-4880-bd45-37b5e42934f5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:39.311697 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e4384fae-a1f7-4880-bd45-37b5e42934f5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:39.325884 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4384fae-a1f7-4880-bd45-37b5e42934f5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:39.326784 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4384fae-a1f7-4880-bd45-37b5e42934f5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:39.327727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4384fae-a1f7-4880-bd45-37b5e42934f5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:39.329212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4384fae-a1f7-4880-bd45-37b5e42934f5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:39.329826 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4384fae-a1f7-4880-bd45-37b5e42934f5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:39.330800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4384fae-a1f7-4880-bd45-37b5e42934f5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:39.700797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e4384fae-a1f7-4880-bd45-37b5e42934f5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:39.710382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e4384fae-a1f7-4880-bd45-37b5e42934f5 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1318 microversion: 2.1 time: 0.410267 Aug 08 02:30:39.724265 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 312/641] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:39 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:40.735008 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-89e3d20d-5a93-4f5e-9f49-cc7181c5fc84 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:40.736341 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-89e3d20d-5a93-4f5e-9f49-cc7181c5fc84 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:40.743767 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-89e3d20d-5a93-4f5e-9f49-cc7181c5fc84 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:40.745670 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-89e3d20d-5a93-4f5e-9f49-cc7181c5fc84 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:40.746437 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-89e3d20d-5a93-4f5e-9f49-cc7181c5fc84 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:40.747981 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-89e3d20d-5a93-4f5e-9f49-cc7181c5fc84 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:40.747981 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-89e3d20d-5a93-4f5e-9f49-cc7181c5fc84 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:40.750449 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-89e3d20d-5a93-4f5e-9f49-cc7181c5fc84 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:41.024190 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-89e3d20d-5a93-4f5e-9f49-cc7181c5fc84 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:41.034986 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-89e3d20d-5a93-4f5e-9f49-cc7181c5fc84 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1507 microversion: 2.1 time: 0.305295 Aug 08 02:30:41.046894 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 330/642] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:40 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:41.061119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-14aefdd0-2700-4833-b4e1-be5122797db3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebac7b7f-7e4b-4314-aeac-ddd7c2e90131", "device": "/dev/sdb"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:30:41.070840 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-14aefdd0-2700-4833-b4e1-be5122797db3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:41.082805 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14aefdd0-2700-4833-b4e1-be5122797db3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:41.083295 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14aefdd0-2700-4833-b4e1-be5122797db3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:41.083765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14aefdd0-2700-4833-b4e1-be5122797db3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:41.084433 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14aefdd0-2700-4833-b4e1-be5122797db3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:41.084887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14aefdd0-2700-4833-b4e1-be5122797db3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:41.085308 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14aefdd0-2700-4833-b4e1-be5122797db3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:41.538939 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-14aefdd0-2700-4833-b4e1-be5122797db3 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "POST /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482943 Aug 08 02:30:41.540015 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 313/643] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:30:41 2022] POST /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:30:51.927926 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-07749b93-440d-4aa7-adb4-7b35a578f258 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Action: 'create', calling method: .version_select at 0x7f32953bfaf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-287893335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2MXQ0lNdy0tq8TB/QuYoFBXwwLY7jWaYYjQF+8GlzfIEac6PwIZGudlGEzN8A8CnmIU9pug4JXw5QvTfZlNC+j0dyD5XMYvb5Yccv70TfdmeMRvJTE+1AKt1gFqkYSjg=="}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:30:51.933759 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=11 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:51.934436 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=22 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:51.946880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-07749b93-440d-4aa7-adb4-7b35a578f258 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Getting quotas for project ef9eec76edd24a338dc9fdd966fceacd. Resources: {'key_pairs'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:30:51.950603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-07749b93-440d-4aa7-adb4-7b35a578f258 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Getting quotas for user 714f7c450ca945d4b2e149153ccfcdce and project ef9eec76edd24a338dc9fdd966fceacd. Resources: {'key_pairs'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:30:51.973804 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-07749b93-440d-4aa7-adb4-7b35a578f258 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049803 Aug 08 02:30:51.974401 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 331/644] 10.222.0.39 () {60 vars in 1159 bytes} [Mon Aug 8 02:30:51 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:30:52.020761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=13 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:52.021529 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:30:52.025728 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-255054718", "imageRef": "e22d2216-40de-4373-8ae6-56e10aca2966", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-287893335", "networks": [{"uuid": "9e3dbb7a-cb0e-4ac9-9890-8c1b6f8388f6"}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:30:52.077771 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] validate_networks() for [('9e3dbb7a-cb0e-4ac9-9890-8c1b6f8388f6', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:30:52.542095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:30:52.542772 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:30:52.543335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:30:52.543814 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:30:52.544394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:30:52.554834 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:52.555443 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:52.555878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:52.556604 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:52.557062 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:52.557488 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:52.574199 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Getting quotas for project ef9eec76edd24a338dc9fdd966fceacd. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:30:52.578105 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Getting quotas for user 714f7c450ca945d4b2e149153ccfcdce and project ef9eec76edd24a338dc9fdd966fceacd. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:30:52.589247 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:30:52.591560 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e22d2216-40de-4373-8ae6-56e10aca2966',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:30:52.634678 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-706414eb-23f2-4236-adad-017d0c0cc5a1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615124 Aug 08 02:30:52.635330 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 314/645] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:30:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:30:52.646546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0ec2ba07-5b80-44d4-be91-03a7bbb541a2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:52.647167 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0ec2ba07-5b80-44d4-be91-03a7bbb541a2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:52.702736 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0ec2ba07-5b80-44d4-be91-03a7bbb541a2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:52.709988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0ec2ba07-5b80-44d4-be91-03a7bbb541a2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1257 microversion: 2.1 time: 0.067385 Aug 08 02:30:52.710570 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 332/646] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:52 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:53.731682 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-89c87dc1-9093-4dd9-bfbc-7ab53f14d114 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:53.732295 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-89c87dc1-9093-4dd9-bfbc-7ab53f14d114 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:53.739718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89c87dc1-9093-4dd9-bfbc-7ab53f14d114 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:53.740197 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89c87dc1-9093-4dd9-bfbc-7ab53f14d114 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:53.740622 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89c87dc1-9093-4dd9-bfbc-7ab53f14d114 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:53.741312 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89c87dc1-9093-4dd9-bfbc-7ab53f14d114 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:53.741759 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89c87dc1-9093-4dd9-bfbc-7ab53f14d114 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:53.742175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89c87dc1-9093-4dd9-bfbc-7ab53f14d114 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:53.802491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-89c87dc1-9093-4dd9-bfbc-7ab53f14d114 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:53.809961 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-89c87dc1-9093-4dd9-bfbc-7ab53f14d114 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1261 microversion: 2.1 time: 0.082666 Aug 08 02:30:53.810472 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 315/647] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:53 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:54.830917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-bc8e48ab-ede9-4109-a875-adde8bd5ac57 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:54.831726 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-bc8e48ab-ede9-4109-a875-adde8bd5ac57 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:54.838741 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bc8e48ab-ede9-4109-a875-adde8bd5ac57 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:54.839379 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bc8e48ab-ede9-4109-a875-adde8bd5ac57 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:54.840838 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bc8e48ab-ede9-4109-a875-adde8bd5ac57 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:54.842188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bc8e48ab-ede9-4109-a875-adde8bd5ac57 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:54.842188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bc8e48ab-ede9-4109-a875-adde8bd5ac57 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:54.842618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bc8e48ab-ede9-4109-a875-adde8bd5ac57 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:54.917700 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-bc8e48ab-ede9-4109-a875-adde8bd5ac57 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:54.927145 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-bc8e48ab-ede9-4109-a875-adde8bd5ac57 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1315 microversion: 2.1 time: 0.100111 Aug 08 02:30:54.927936 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 333/648] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:54 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1315 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:55.950034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e1f801e0-424b-45aa-868d-446cbcdeb246 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:55.950613 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e1f801e0-424b-45aa-868d-446cbcdeb246 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:55.957466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1f801e0-424b-45aa-868d-446cbcdeb246 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:55.957937 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1f801e0-424b-45aa-868d-446cbcdeb246 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:55.958393 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1f801e0-424b-45aa-868d-446cbcdeb246 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:55.959075 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1f801e0-424b-45aa-868d-446cbcdeb246 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:55.959517 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1f801e0-424b-45aa-868d-446cbcdeb246 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:55.959935 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e1f801e0-424b-45aa-868d-446cbcdeb246 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:56.092029 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e1f801e0-424b-45aa-868d-446cbcdeb246 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:56.100511 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e1f801e0-424b-45aa-868d-446cbcdeb246 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.154363 Aug 08 02:30:56.101088 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 316/649] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:55 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:57.121587 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-06ff7353-eb3b-4dc4-a6a3-25f760cdd927 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:57.122124 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-06ff7353-eb3b-4dc4-a6a3-25f760cdd927 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:57.129136 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-06ff7353-eb3b-4dc4-a6a3-25f760cdd927 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:57.129612 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-06ff7353-eb3b-4dc4-a6a3-25f760cdd927 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:57.130035 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-06ff7353-eb3b-4dc4-a6a3-25f760cdd927 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:57.130742 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-06ff7353-eb3b-4dc4-a6a3-25f760cdd927 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:57.131186 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-06ff7353-eb3b-4dc4-a6a3-25f760cdd927 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:57.131601 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-06ff7353-eb3b-4dc4-a6a3-25f760cdd927 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:57.270971 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-06ff7353-eb3b-4dc4-a6a3-25f760cdd927 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:57.278755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-06ff7353-eb3b-4dc4-a6a3-25f760cdd927 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.160977 Aug 08 02:30:57.279323 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 334/650] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:57 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:58.298378 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-16de3dbe-783b-4e88-968c-8455d7d13f08 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:58.298992 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-16de3dbe-783b-4e88-968c-8455d7d13f08 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:58.305297 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16de3dbe-783b-4e88-968c-8455d7d13f08 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:58.305778 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16de3dbe-783b-4e88-968c-8455d7d13f08 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:58.306238 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16de3dbe-783b-4e88-968c-8455d7d13f08 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:58.306944 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16de3dbe-783b-4e88-968c-8455d7d13f08 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:58.307390 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16de3dbe-783b-4e88-968c-8455d7d13f08 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:58.307805 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16de3dbe-783b-4e88-968c-8455d7d13f08 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:58.437395 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-16de3dbe-783b-4e88-968c-8455d7d13f08 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:58.445070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-16de3dbe-783b-4e88-968c-8455d7d13f08 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.150475 Aug 08 02:30:58.445643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 317/651] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:58 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:30:59.465765 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5344d6ef-b63c-465f-a0c1-6e0d58c42b9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:30:59.466396 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5344d6ef-b63c-465f-a0c1-6e0d58c42b9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:30:59.473271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5344d6ef-b63c-465f-a0c1-6e0d58c42b9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:59.473742 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5344d6ef-b63c-465f-a0c1-6e0d58c42b9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:59.474168 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5344d6ef-b63c-465f-a0c1-6e0d58c42b9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:59.474957 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5344d6ef-b63c-465f-a0c1-6e0d58c42b9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:30:59.475403 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5344d6ef-b63c-465f-a0c1-6e0d58c42b9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:30:59.475816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5344d6ef-b63c-465f-a0c1-6e0d58c42b9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:30:59.603621 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5344d6ef-b63c-465f-a0c1-6e0d58c42b9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:30:59.611675 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5344d6ef-b63c-465f-a0c1-6e0d58c42b9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.149707 Aug 08 02:30:59.612170 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 335/652] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:30:59 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:00.633214 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-41d2b637-028d-4b1d-b6bf-af45816624b9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:00.633890 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-41d2b637-028d-4b1d-b6bf-af45816624b9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:00.641070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d2b637-028d-4b1d-b6bf-af45816624b9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:00.641558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d2b637-028d-4b1d-b6bf-af45816624b9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:00.641988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d2b637-028d-4b1d-b6bf-af45816624b9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:00.642733 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d2b637-028d-4b1d-b6bf-af45816624b9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:00.643302 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d2b637-028d-4b1d-b6bf-af45816624b9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:00.643726 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d2b637-028d-4b1d-b6bf-af45816624b9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:00.779761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-41d2b637-028d-4b1d-b6bf-af45816624b9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:00.787398 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-41d2b637-028d-4b1d-b6bf-af45816624b9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.158633 Aug 08 02:31:00.788005 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 318/653] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:00 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:01.808678 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ca7387ff-d2ae-4d4b-8ad7-a034a8532e9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:01.810080 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ca7387ff-d2ae-4d4b-8ad7-a034a8532e9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:01.817880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ca7387ff-d2ae-4d4b-8ad7-a034a8532e9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:01.818622 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ca7387ff-d2ae-4d4b-8ad7-a034a8532e9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:01.819138 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ca7387ff-d2ae-4d4b-8ad7-a034a8532e9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:01.819907 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ca7387ff-d2ae-4d4b-8ad7-a034a8532e9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:01.820425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ca7387ff-d2ae-4d4b-8ad7-a034a8532e9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:01.820913 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ca7387ff-d2ae-4d4b-8ad7-a034a8532e9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:01.956995 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ca7387ff-d2ae-4d4b-8ad7-a034a8532e9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:01.965880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ca7387ff-d2ae-4d4b-8ad7-a034a8532e9a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.161119 Aug 08 02:31:01.966581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 336/654] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:01 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:02.986423 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-efe2d6ff-9170-4994-8446-690489b51926 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:02.987067 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-efe2d6ff-9170-4994-8446-690489b51926 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:02.989377 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:02.990038 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:02.995819 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efe2d6ff-9170-4994-8446-690489b51926 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:02.996300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efe2d6ff-9170-4994-8446-690489b51926 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:02.996731 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efe2d6ff-9170-4994-8446-690489b51926 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:02.997411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efe2d6ff-9170-4994-8446-690489b51926 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:02.997860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efe2d6ff-9170-4994-8446-690489b51926 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:02.998302 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efe2d6ff-9170-4994-8446-690489b51926 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:03.126761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-efe2d6ff-9170-4994-8446-690489b51926 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:03.134265 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-efe2d6ff-9170-4994-8446-690489b51926 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.151730 Aug 08 02:31:03.134832 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 319/655] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:02 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:04.155598 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b73fcc7e-01d8-4c1f-a64a-bae7e6197e18 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:04.156214 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b73fcc7e-01d8-4c1f-a64a-bae7e6197e18 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:04.158547 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=6 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:04.164234 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b73fcc7e-01d8-4c1f-a64a-bae7e6197e18 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:04.164715 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b73fcc7e-01d8-4c1f-a64a-bae7e6197e18 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:04.165150 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b73fcc7e-01d8-4c1f-a64a-bae7e6197e18 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:04.165837 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b73fcc7e-01d8-4c1f-a64a-bae7e6197e18 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:04.166306 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b73fcc7e-01d8-4c1f-a64a-bae7e6197e18 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:04.166732 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b73fcc7e-01d8-4c1f-a64a-bae7e6197e18 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:04.295593 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b73fcc7e-01d8-4c1f-a64a-bae7e6197e18 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:04.303067 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b73fcc7e-01d8-4c1f-a64a-bae7e6197e18 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.151284 Aug 08 02:31:04.303631 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 337/656] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:04 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:05.330377 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d94f6598-b39c-4ff3-ad12-24f7fd44c645 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:05.330377 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d94f6598-b39c-4ff3-ad12-24f7fd44c645 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:05.335155 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d94f6598-b39c-4ff3-ad12-24f7fd44c645 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:05.335979 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d94f6598-b39c-4ff3-ad12-24f7fd44c645 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:05.336425 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d94f6598-b39c-4ff3-ad12-24f7fd44c645 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:05.337134 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d94f6598-b39c-4ff3-ad12-24f7fd44c645 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:05.337583 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d94f6598-b39c-4ff3-ad12-24f7fd44c645 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:05.338349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d94f6598-b39c-4ff3-ad12-24f7fd44c645 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:05.478320 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d94f6598-b39c-4ff3-ad12-24f7fd44c645 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:05.485860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d94f6598-b39c-4ff3-ad12-24f7fd44c645 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.165778 Aug 08 02:31:05.492232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 320/657] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:05 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:06.505975 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b1d941bb-50ce-409d-b8e3-454a9d214ca6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:06.506611 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b1d941bb-50ce-409d-b8e3-454a9d214ca6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:06.513344 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b1d941bb-50ce-409d-b8e3-454a9d214ca6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:06.513818 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b1d941bb-50ce-409d-b8e3-454a9d214ca6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:06.514263 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b1d941bb-50ce-409d-b8e3-454a9d214ca6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:06.514951 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b1d941bb-50ce-409d-b8e3-454a9d214ca6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:06.515403 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b1d941bb-50ce-409d-b8e3-454a9d214ca6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:06.515824 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b1d941bb-50ce-409d-b8e3-454a9d214ca6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:06.650593 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b1d941bb-50ce-409d-b8e3-454a9d214ca6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:06.658668 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b1d941bb-50ce-409d-b8e3-454a9d214ca6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.156583 Aug 08 02:31:06.659235 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 338/658] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:06 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:07.679720 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-662d33b6-5713-4165-9d7c-dc85dbaa8ff2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:07.680295 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-662d33b6-5713-4165-9d7c-dc85dbaa8ff2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:07.686593 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-662d33b6-5713-4165-9d7c-dc85dbaa8ff2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:07.687066 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-662d33b6-5713-4165-9d7c-dc85dbaa8ff2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:07.687493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-662d33b6-5713-4165-9d7c-dc85dbaa8ff2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:07.688232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-662d33b6-5713-4165-9d7c-dc85dbaa8ff2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:07.688681 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-662d33b6-5713-4165-9d7c-dc85dbaa8ff2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:07.689101 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-662d33b6-5713-4165-9d7c-dc85dbaa8ff2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:07.823028 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-662d33b6-5713-4165-9d7c-dc85dbaa8ff2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:07.830825 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-662d33b6-5713-4165-9d7c-dc85dbaa8ff2 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.155048 Aug 08 02:31:07.831401 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 321/659] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:07 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:08.851250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-73040ff2-8a31-4e81-ae3d-963a74a148bb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:08.851902 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-73040ff2-8a31-4e81-ae3d-963a74a148bb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:08.857880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-73040ff2-8a31-4e81-ae3d-963a74a148bb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:08.858407 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-73040ff2-8a31-4e81-ae3d-963a74a148bb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:08.858822 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-73040ff2-8a31-4e81-ae3d-963a74a148bb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:08.859493 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-73040ff2-8a31-4e81-ae3d-963a74a148bb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:08.860426 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-73040ff2-8a31-4e81-ae3d-963a74a148bb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:08.860836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-73040ff2-8a31-4e81-ae3d-963a74a148bb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:08.994126 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-73040ff2-8a31-4e81-ae3d-963a74a148bb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:09.003836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-73040ff2-8a31-4e81-ae3d-963a74a148bb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.156109 Aug 08 02:31:09.004741 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 339/660] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:08 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:10.026756 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6abcd415-de96-4ada-b2a3-e754f351f7a6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:10.027455 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6abcd415-de96-4ada-b2a3-e754f351f7a6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:10.034273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6abcd415-de96-4ada-b2a3-e754f351f7a6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:10.034773 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6abcd415-de96-4ada-b2a3-e754f351f7a6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:10.035201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6abcd415-de96-4ada-b2a3-e754f351f7a6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:10.035895 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6abcd415-de96-4ada-b2a3-e754f351f7a6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:10.036342 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6abcd415-de96-4ada-b2a3-e754f351f7a6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:10.036756 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6abcd415-de96-4ada-b2a3-e754f351f7a6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:10.173739 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6abcd415-de96-4ada-b2a3-e754f351f7a6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:10.181682 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6abcd415-de96-4ada-b2a3-e754f351f7a6 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.158733 Aug 08 02:31:10.182288 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 322/661] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:10 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:11.205660 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0303905d-3c54-40de-9ffe-1842a82f3c33 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:11.206284 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0303905d-3c54-40de-9ffe-1842a82f3c33 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:11.212641 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0303905d-3c54-40de-9ffe-1842a82f3c33 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:11.213111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0303905d-3c54-40de-9ffe-1842a82f3c33 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:11.213537 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0303905d-3c54-40de-9ffe-1842a82f3c33 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:11.214207 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0303905d-3c54-40de-9ffe-1842a82f3c33 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:11.214677 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0303905d-3c54-40de-9ffe-1842a82f3c33 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:11.215087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0303905d-3c54-40de-9ffe-1842a82f3c33 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:11.338880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0303905d-3c54-40de-9ffe-1842a82f3c33 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:11.346592 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0303905d-3c54-40de-9ffe-1842a82f3c33 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.145023 Aug 08 02:31:11.347161 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 340/662] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:11 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:12.366907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-11c28743-331c-4244-87c8-cf9de7bded48 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:12.367515 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-11c28743-331c-4244-87c8-cf9de7bded48 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:12.374135 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11c28743-331c-4244-87c8-cf9de7bded48 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:12.374640 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11c28743-331c-4244-87c8-cf9de7bded48 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:12.375073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11c28743-331c-4244-87c8-cf9de7bded48 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:12.376241 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11c28743-331c-4244-87c8-cf9de7bded48 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:12.376681 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11c28743-331c-4244-87c8-cf9de7bded48 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:12.377096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11c28743-331c-4244-87c8-cf9de7bded48 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:12.512567 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-11c28743-331c-4244-87c8-cf9de7bded48 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:12.520069 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-11c28743-331c-4244-87c8-cf9de7bded48 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.156961 Aug 08 02:31:12.520637 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 323/663] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:12 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:13.540341 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6f1263e5-e6da-4cc7-b4b1-147e2049ba6a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:13.540946 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6f1263e5-e6da-4cc7-b4b1-147e2049ba6a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:13.547686 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6f1263e5-e6da-4cc7-b4b1-147e2049ba6a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:13.548177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6f1263e5-e6da-4cc7-b4b1-147e2049ba6a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:13.548572 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6f1263e5-e6da-4cc7-b4b1-147e2049ba6a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:13.549252 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6f1263e5-e6da-4cc7-b4b1-147e2049ba6a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:13.549694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6f1263e5-e6da-4cc7-b4b1-147e2049ba6a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:13.550107 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6f1263e5-e6da-4cc7-b4b1-147e2049ba6a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:13.557366 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-25bb5740-f14e-4fe2-b4b6-0b379de27d4b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:13.557933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-25bb5740-f14e-4fe2-b4b6-0b379de27d4b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:13.565368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25bb5740-f14e-4fe2-b4b6-0b379de27d4b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:13.566149 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25bb5740-f14e-4fe2-b4b6-0b379de27d4b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:13.566795 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25bb5740-f14e-4fe2-b4b6-0b379de27d4b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:13.567519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25bb5740-f14e-4fe2-b4b6-0b379de27d4b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:13.567978 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25bb5740-f14e-4fe2-b4b6-0b379de27d4b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:13.568405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25bb5740-f14e-4fe2-b4b6-0b379de27d4b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:13.652928 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-25bb5740-f14e-4fe2-b4b6-0b379de27d4b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lazy-loading 'services' on Instance uuid 562ec29d-9b72-4bd5-acb6-947fa74a726d {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:31:13.695712 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6f1263e5-e6da-4cc7-b4b1-147e2049ba6a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:13.703205 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6f1263e5-e6da-4cc7-b4b1-147e2049ba6a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.166630 Aug 08 02:31:13.704353 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 341/664] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:13 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:13.730851 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-25bb5740-f14e-4fe2-b4b6-0b379de27d4b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "DELETE /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d/os-volume_attachments/ebac7b7f-7e4b-4314-aeac-ddd7c2e90131" status: 202 len: 0 microversion: 2.1 time: 0.177210 Aug 08 02:31:13.731554 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 324/665] 10.222.0.39 () {58 vars in 1416 bytes} [Mon Aug 8 02:31:13 2022] DELETE /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d/os-volume_attachments/ebac7b7f-7e4b-4314-aeac-ddd7c2e90131 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:31:14.724584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-72e583d6-e8fb-4118-976d-727bdd044f7e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:14.725114 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-72e583d6-e8fb-4118-976d-727bdd044f7e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:14.731624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72e583d6-e8fb-4118-976d-727bdd044f7e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:14.732099 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72e583d6-e8fb-4118-976d-727bdd044f7e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:14.732536 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72e583d6-e8fb-4118-976d-727bdd044f7e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:14.733216 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72e583d6-e8fb-4118-976d-727bdd044f7e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:14.733664 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72e583d6-e8fb-4118-976d-727bdd044f7e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:14.734081 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72e583d6-e8fb-4118-976d-727bdd044f7e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:14.863939 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-72e583d6-e8fb-4118-976d-727bdd044f7e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:14.871244 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-72e583d6-e8fb-4118-976d-727bdd044f7e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.150557 Aug 08 02:31:14.871801 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 342/666] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:14 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:15.894572 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-885f40d9-fc19-4780-a9bc-dce3db29a4d1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:15.897595 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-885f40d9-fc19-4780-a9bc-dce3db29a4d1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:15.910948 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-885f40d9-fc19-4780-a9bc-dce3db29a4d1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:15.911439 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-885f40d9-fc19-4780-a9bc-dce3db29a4d1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:15.911874 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-885f40d9-fc19-4780-a9bc-dce3db29a4d1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:15.912577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-885f40d9-fc19-4780-a9bc-dce3db29a4d1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:15.913109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-885f40d9-fc19-4780-a9bc-dce3db29a4d1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:15.913539 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-885f40d9-fc19-4780-a9bc-dce3db29a4d1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:16.043748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-885f40d9-fc19-4780-a9bc-dce3db29a4d1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:16.051240 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-885f40d9-fc19-4780-a9bc-dce3db29a4d1 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.162093 Aug 08 02:31:16.051805 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 325/667] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:15 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:16.530911 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-cb772dd5-f0ad-4482-8c3a-61cb9633bae0 req-6edb171e-c891-45e0-abe4-af8dfbada153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80280a99-0ab1-4981-96ff-9bebd5488772", "tag": "0cf66020-aef8-4e07-8464-3cd2cc846c95"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:31:16.540737 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-cb772dd5-f0ad-4482-8c3a-61cb9633bae0 req-6edb171e-c891-45e0-abe4-af8dfbada153 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:16.541283 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-cb772dd5-f0ad-4482-8c3a-61cb9633bae0 req-6edb171e-c891-45e0-abe4-af8dfbada153 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:16.541778 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-cb772dd5-f0ad-4482-8c3a-61cb9633bae0 req-6edb171e-c891-45e0-abe4-af8dfbada153 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:16.555840 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-cb772dd5-f0ad-4482-8c3a-61cb9633bae0 req-6edb171e-c891-45e0-abe4-af8dfbada153 service nova] Creating event network-changed:0cf66020-aef8-4e07-8464-3cd2cc846c95 for instance 80280a99-0ab1-4981-96ff-9bebd5488772 on hv-cinder-73306 Aug 08 02:31:16.561221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-cb772dd5-f0ad-4482-8c3a-61cb9633bae0 req-6edb171e-c891-45e0-abe4-af8dfbada153 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152257 Aug 08 02:31:16.562943 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 343/668] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:31:17.072259 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e767b0a7-9984-4c9a-9472-c975dfd1e3fe tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:17.072878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e767b0a7-9984-4c9a-9472-c975dfd1e3fe tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:17.079745 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e767b0a7-9984-4c9a-9472-c975dfd1e3fe tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:17.080429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e767b0a7-9984-4c9a-9472-c975dfd1e3fe tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:17.080861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e767b0a7-9984-4c9a-9472-c975dfd1e3fe tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:17.081548 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e767b0a7-9984-4c9a-9472-c975dfd1e3fe tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:17.081995 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e767b0a7-9984-4c9a-9472-c975dfd1e3fe tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:17.082528 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e767b0a7-9984-4c9a-9472-c975dfd1e3fe tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:17.221854 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e767b0a7-9984-4c9a-9472-c975dfd1e3fe tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:17.229172 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e767b0a7-9984-4c9a-9472-c975dfd1e3fe tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.160793 Aug 08 02:31:17.229733 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 326/669] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:17 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:18.023522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9925bf4d-e3de-4536-a076-a10bbb0be10b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:18.024108 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9925bf4d-e3de-4536-a076-a10bbb0be10b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:18.030697 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9925bf4d-e3de-4536-a076-a10bbb0be10b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:18.031180 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9925bf4d-e3de-4536-a076-a10bbb0be10b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:18.031912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9925bf4d-e3de-4536-a076-a10bbb0be10b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:18.033085 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9925bf4d-e3de-4536-a076-a10bbb0be10b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:18.033536 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9925bf4d-e3de-4536-a076-a10bbb0be10b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:18.033957 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9925bf4d-e3de-4536-a076-a10bbb0be10b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:18.058921 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9925bf4d-e3de-4536-a076-a10bbb0be10b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:31:18.129329 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9925bf4d-e3de-4536-a076-a10bbb0be10b tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "DELETE /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 204 len: 0 microversion: 2.1 time: 0.109732 Aug 08 02:31:18.129906 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 344/670] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:31:18 2022] DELETE /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:31:18.137882 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d35ed47d-09c1-40b5-a997-b09db43c0c56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:18.138512 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d35ed47d-09c1-40b5-a997-b09db43c0c56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:18.144959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d35ed47d-09c1-40b5-a997-b09db43c0c56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:18.145630 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d35ed47d-09c1-40b5-a997-b09db43c0c56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:18.146059 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d35ed47d-09c1-40b5-a997-b09db43c0c56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:18.146764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d35ed47d-09c1-40b5-a997-b09db43c0c56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:18.147210 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d35ed47d-09c1-40b5-a997-b09db43c0c56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:18.147625 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d35ed47d-09c1-40b5-a997-b09db43c0c56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:18.249825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-aa9d73bd-4ba4-46ef-9d25-29bf4d83e776 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:18.250544 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-aa9d73bd-4ba4-46ef-9d25-29bf4d83e776 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:18.256383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-aa9d73bd-4ba4-46ef-9d25-29bf4d83e776 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:18.256977 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-aa9d73bd-4ba4-46ef-9d25-29bf4d83e776 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:18.257405 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-aa9d73bd-4ba4-46ef-9d25-29bf4d83e776 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:18.258082 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-aa9d73bd-4ba4-46ef-9d25-29bf4d83e776 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:18.258551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-aa9d73bd-4ba4-46ef-9d25-29bf4d83e776 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:18.258966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-aa9d73bd-4ba4-46ef-9d25-29bf4d83e776 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:18.277475 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d35ed47d-09c1-40b5-a997-b09db43c0c56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:18.285439 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d35ed47d-09c1-40b5-a997-b09db43c0c56 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1513 microversion: 2.1 time: 0.151335 Aug 08 02:31:18.286012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 327/671] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:18 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:18.390696 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-aa9d73bd-4ba4-46ef-9d25-29bf4d83e776 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:18.398671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-aa9d73bd-4ba4-46ef-9d25-29bf4d83e776 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.153141 Aug 08 02:31:18.399236 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 345/672] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:18 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:31:19.307058 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6b0f546f-df03-4259-9bdc-f124e9c2594a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:19.307674 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6b0f546f-df03-4259-9bdc-f124e9c2594a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:19.315003 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b0f546f-df03-4259-9bdc-f124e9c2594a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:19.315488 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b0f546f-df03-4259-9bdc-f124e9c2594a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:19.315930 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b0f546f-df03-4259-9bdc-f124e9c2594a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:19.316619 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b0f546f-df03-4259-9bdc-f124e9c2594a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:19.317094 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b0f546f-df03-4259-9bdc-f124e9c2594a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:19.317520 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b0f546f-df03-4259-9bdc-f124e9c2594a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:19.419577 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c072117f-7ac6-4e3b-972b-ca1db1951c37 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:19.420088 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c072117f-7ac6-4e3b-972b-ca1db1951c37 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:19.427081 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c072117f-7ac6-4e3b-972b-ca1db1951c37 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:19.427573 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c072117f-7ac6-4e3b-972b-ca1db1951c37 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:19.428009 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c072117f-7ac6-4e3b-972b-ca1db1951c37 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:19.428695 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c072117f-7ac6-4e3b-972b-ca1db1951c37 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:19.429150 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c072117f-7ac6-4e3b-972b-ca1db1951c37 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:19.429571 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c072117f-7ac6-4e3b-972b-ca1db1951c37 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:19.446121 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6b0f546f-df03-4259-9bdc-f124e9c2594a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:19.453527 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6b0f546f-df03-4259-9bdc-f124e9c2594a tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1513 microversion: 2.1 time: 0.150346 Aug 08 02:31:19.454098 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 328/673] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:19 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:19.558551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c072117f-7ac6-4e3b-972b-ca1db1951c37 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:19.566063 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c072117f-7ac6-4e3b-972b-ca1db1951c37 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.150406 Aug 08 02:31:19.566657 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 346/674] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:19 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:31:20.475236 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d93fc41d-0713-4438-b1be-6ebb1a3015c2 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:20.475891 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d93fc41d-0713-4438-b1be-6ebb1a3015c2 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:20.482417 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d93fc41d-0713-4438-b1be-6ebb1a3015c2 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:20.482999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d93fc41d-0713-4438-b1be-6ebb1a3015c2 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:20.483513 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d93fc41d-0713-4438-b1be-6ebb1a3015c2 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:20.484281 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d93fc41d-0713-4438-b1be-6ebb1a3015c2 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:20.484743 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d93fc41d-0713-4438-b1be-6ebb1a3015c2 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:20.485172 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d93fc41d-0713-4438-b1be-6ebb1a3015c2 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:20.589011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-cc89d914-6c41-4c00-8f5d-480f400ffd32 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:20.589615 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-cc89d914-6c41-4c00-8f5d-480f400ffd32 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:20.599077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cc89d914-6c41-4c00-8f5d-480f400ffd32 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:20.599556 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cc89d914-6c41-4c00-8f5d-480f400ffd32 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:20.599982 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cc89d914-6c41-4c00-8f5d-480f400ffd32 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:20.600675 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cc89d914-6c41-4c00-8f5d-480f400ffd32 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:20.601118 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cc89d914-6c41-4c00-8f5d-480f400ffd32 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:20.601534 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cc89d914-6c41-4c00-8f5d-480f400ffd32 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:20.620679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d93fc41d-0713-4438-b1be-6ebb1a3015c2 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:20.628456 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d93fc41d-0713-4438-b1be-6ebb1a3015c2 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1513 microversion: 2.1 time: 0.157592 Aug 08 02:31:20.629025 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 329/675] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:20 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:20.731673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-cc89d914-6c41-4c00-8f5d-480f400ffd32 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:20.739670 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-cc89d914-6c41-4c00-8f5d-480f400ffd32 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.154531 Aug 08 02:31:20.740231 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 347/676] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:20 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:21.650370 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-038a9ef4-5831-4fe3-9c16-be4d53aa0c48 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:21.650987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-038a9ef4-5831-4fe3-9c16-be4d53aa0c48 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:21.657222 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-038a9ef4-5831-4fe3-9c16-be4d53aa0c48 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:21.658361 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-038a9ef4-5831-4fe3-9c16-be4d53aa0c48 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:21.658820 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-038a9ef4-5831-4fe3-9c16-be4d53aa0c48 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:21.659508 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-038a9ef4-5831-4fe3-9c16-be4d53aa0c48 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:21.659962 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-038a9ef4-5831-4fe3-9c16-be4d53aa0c48 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:21.660381 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-038a9ef4-5831-4fe3-9c16-be4d53aa0c48 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:21.678000 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:21.760802 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-033b9dbc-7968-49cb-bf41-cc95f8fb5af3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:21.761525 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-033b9dbc-7968-49cb-bf41-cc95f8fb5af3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:21.768380 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-033b9dbc-7968-49cb-bf41-cc95f8fb5af3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:21.768931 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-033b9dbc-7968-49cb-bf41-cc95f8fb5af3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:21.769431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-033b9dbc-7968-49cb-bf41-cc95f8fb5af3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:21.770186 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-033b9dbc-7968-49cb-bf41-cc95f8fb5af3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:21.770727 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-033b9dbc-7968-49cb-bf41-cc95f8fb5af3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:21.771217 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-033b9dbc-7968-49cb-bf41-cc95f8fb5af3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:21.790072 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:21.790343 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-038a9ef4-5831-4fe3-9c16-be4d53aa0c48 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:21.798077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-038a9ef4-5831-4fe3-9c16-be4d53aa0c48 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1513 microversion: 2.1 time: 0.151714 Aug 08 02:31:21.798684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 330/677] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:21 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:21.902173 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-033b9dbc-7968-49cb-bf41-cc95f8fb5af3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:21.909482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-033b9dbc-7968-49cb-bf41-cc95f8fb5af3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.152486 Aug 08 02:31:21.910061 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 348/678] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:21 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:31:22.819833 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-150b7229-4cc6-4736-ba4a-78a840cb7265 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:22.820446 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-150b7229-4cc6-4736-ba4a-78a840cb7265 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:22.822741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:22.827933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-150b7229-4cc6-4736-ba4a-78a840cb7265 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:22.828415 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-150b7229-4cc6-4736-ba4a-78a840cb7265 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:22.828848 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-150b7229-4cc6-4736-ba4a-78a840cb7265 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:22.830182 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-150b7229-4cc6-4736-ba4a-78a840cb7265 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:22.830657 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-150b7229-4cc6-4736-ba4a-78a840cb7265 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:22.831078 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-150b7229-4cc6-4736-ba4a-78a840cb7265 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:22.929465 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6883942d-fa2e-4b8b-affb-c68ce174e17c tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:22.930056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6883942d-fa2e-4b8b-affb-c68ce174e17c tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:22.932651 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:22.940683 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6883942d-fa2e-4b8b-affb-c68ce174e17c tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:22.941245 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6883942d-fa2e-4b8b-affb-c68ce174e17c tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:22.941959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6883942d-fa2e-4b8b-affb-c68ce174e17c tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:22.942817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6883942d-fa2e-4b8b-affb-c68ce174e17c tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:22.943358 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6883942d-fa2e-4b8b-affb-c68ce174e17c tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:22.943886 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6883942d-fa2e-4b8b-affb-c68ce174e17c tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:22.966143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-150b7229-4cc6-4736-ba4a-78a840cb7265 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2ca1a30a76468cbe02b20efd6ca37e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d75f4c0fe9148e7bf633a79dbfd6bb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:22.973886 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-150b7229-4cc6-4736-ba4a-78a840cb7265 tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 200 len: 1513 microversion: 2.1 time: 0.157879 Aug 08 02:31:22.974630 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 331/679] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:22 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:23.151807 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6883942d-fa2e-4b8b-affb-c68ce174e17c tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:23.159184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6883942d-fa2e-4b8b-affb-c68ce174e17c tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.233506 Aug 08 02:31:23.159743 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 349/680] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:22 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:23.262552 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-04d69af7-263a-4e3f-8efd-3f4d04592bb9 req-2a98ea21-28d4-4e52-8afb-3e4c40bd6739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562ec29d-9b72-4bd5-acb6-947fa74a726d", "name": "network-vif-deleted", "tag": "ccb8ae79-03bc-481f-8f1f-c20fdda89fc0"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:31:23.272152 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-04d69af7-263a-4e3f-8efd-3f4d04592bb9 req-2a98ea21-28d4-4e52-8afb-3e4c40bd6739 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:23.272621 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-04d69af7-263a-4e3f-8efd-3f4d04592bb9 req-2a98ea21-28d4-4e52-8afb-3e4c40bd6739 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:23.273045 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-04d69af7-263a-4e3f-8efd-3f4d04592bb9 req-2a98ea21-28d4-4e52-8afb-3e4c40bd6739 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:23.284945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-04d69af7-263a-4e3f-8efd-3f4d04592bb9 req-2a98ea21-28d4-4e52-8afb-3e4c40bd6739 service nova] Creating event network-vif-deleted:ccb8ae79-03bc-481f-8f1f-c20fdda89fc0 for instance 562ec29d-9b72-4bd5-acb6-947fa74a726d on hv-cinder-73306 Aug 08 02:31:23.290547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-04d69af7-263a-4e3f-8efd-3f4d04592bb9 req-2a98ea21-28d4-4e52-8afb-3e4c40bd6739 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031457 Aug 08 02:31:23.291144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 332/681] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:31:23.529808 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-1951259c-1669-41ca-8270-f643ed6d702a req-e516630e-8134-402c-911f-74945fb8b28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80280a99-0ab1-4981-96ff-9bebd5488772", "name": "network-vif-plugged", "status": "completed", "tag": "0cf66020-aef8-4e07-8464-3cd2cc846c95"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:31:23.539544 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-1951259c-1669-41ca-8270-f643ed6d702a req-e516630e-8134-402c-911f-74945fb8b28b service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:23.540009 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-1951259c-1669-41ca-8270-f643ed6d702a req-e516630e-8134-402c-911f-74945fb8b28b service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:23.540434 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-1951259c-1669-41ca-8270-f643ed6d702a req-e516630e-8134-402c-911f-74945fb8b28b service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:23.554604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-1951259c-1669-41ca-8270-f643ed6d702a req-e516630e-8134-402c-911f-74945fb8b28b service nova] Creating event network-vif-plugged:0cf66020-aef8-4e07-8464-3cd2cc846c95 for instance 80280a99-0ab1-4981-96ff-9bebd5488772 on hv-cinder-73306 Aug 08 02:31:23.559816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-1951259c-1669-41ca-8270-f643ed6d702a req-e516630e-8134-402c-911f-74945fb8b28b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089775 Aug 08 02:31:23.560669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 350/682] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:31:23.995886 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-279aeaa4-30c1-4ab4-8b8d-55431a99fe3c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:23.996491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-279aeaa4-30c1-4ab4-8b8d-55431a99fe3c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] [instance: 562ec29d-9b72-4bd5-acb6-947fa74a726d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:24.002535 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-279aeaa4-30c1-4ab4-8b8d-55431a99fe3c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:24.003013 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-279aeaa4-30c1-4ab4-8b8d-55431a99fe3c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:24.003443 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-279aeaa4-30c1-4ab4-8b8d-55431a99fe3c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:24.004128 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-279aeaa4-30c1-4ab4-8b8d-55431a99fe3c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:24.004577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-279aeaa4-30c1-4ab4-8b8d-55431a99fe3c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:24.004996 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-279aeaa4-30c1-4ab4-8b8d-55431a99fe3c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:24.020355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-279aeaa4-30c1-4ab4-8b8d-55431a99fe3c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] HTTP exception thrown: Instance 562ec29d-9b72-4bd5-acb6-947fa74a726d could not be found. Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-279aeaa4-30c1-4ab4-8b8d-55431a99fe3c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Request method failure captured: Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d HTTP/1.1 Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HSpP-k-12ExRlrFMh7KEkIWtAm-63OSTCSn4XY4-Qk_AKJaDd_utJ6tgw2pycV10y896o5o9SIQN6FHA4LqcbmNqfg5gCsHC1eFprsLIvrmFF0u3Q1aviY7KvVmkM6QxiGDqcJq8Wwa0IldsmYXIBlnnIyo5fFYLFG5UCmX7vtxpLU Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 2d75f4c0fe9148e7bf633a79dbfd6bb9 Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1411467720 Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:31:24.021940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:31:24.023533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2d75f4c0fe9148e7bf633a79dbfd6bb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d75f4c0fe9148e7bf633a79dbfd6bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2d75f4c0fe9148e7bf633a79dbfd6bb9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d75f4c0fe9148e7bf633a79dbfd6bb9"}]}] Aug 08 02:31:24.023533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotTestJSON-1411467720 Aug 08 02:31:24.023533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 2d75f4c0fe9148e7bf633a79dbfd6bb9 Aug 08 02:31:24.023533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1411467720 Aug 08 02:31:24.023533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotTestJSON-1411467720-project Aug 08 02:31:24.023533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:31:24.023533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:31:24.023533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: ef2ca1a30a76468cbe02b20efd6ca37e Aug 08 02:31:24.023533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotTestJSON-1411467720-project Aug 08 02:31:24.023533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:31:24.023533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 562ec29d-9b72-4bd5-acb6-947fa74a726d could not be found. Aug 08 02:31:24.023533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '562ec29d-9b72-4bd5-acb6-947fa74a726d'} Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562ec29d-9b72-4bd5-acb6-947fa74a726d could not be found. Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:31:24.024431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562ec29d-9b72-4bd5-acb6-947fa74a726d could not be found. Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562ec29d-9b72-4bd5-acb6-947fa74a726d could not be found. Aug 08 02:31:24.025975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:31:24.027541 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-279aeaa4-30c1-4ab4-8b8d-55431a99fe3c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] Returning 404 to user: Instance 562ec29d-9b72-4bd5-acb6-947fa74a726d could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:31:24.027541 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-279aeaa4-30c1-4ab4-8b8d-55431a99fe3c tempest-VolumesSnapshotTestJSON-1411467720 tempest-VolumesSnapshotTestJSON-1411467720-project] 10.222.0.39 "GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d" status: 404 len: 111 microversion: 2.1 time: 0.032492 Aug 08 02:31:24.027541 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 333/683] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:23 2022] GET /compute/v2.1/servers/562ec29d-9b72-4bd5-acb6-947fa74a726d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:31:24.180981 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-76b7f70a-75de-4f79-ba3f-851b23c05907 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:24.181677 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-76b7f70a-75de-4f79-ba3f-851b23c05907 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:24.187794 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-76b7f70a-75de-4f79-ba3f-851b23c05907 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:24.188276 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-76b7f70a-75de-4f79-ba3f-851b23c05907 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:24.189312 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-76b7f70a-75de-4f79-ba3f-851b23c05907 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:24.190410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-76b7f70a-75de-4f79-ba3f-851b23c05907 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:24.190756 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-76b7f70a-75de-4f79-ba3f-851b23c05907 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:24.191184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-76b7f70a-75de-4f79-ba3f-851b23c05907 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:24.343391 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-76b7f70a-75de-4f79-ba3f-851b23c05907 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:24.351014 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-76b7f70a-75de-4f79-ba3f-851b23c05907 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.174813 Aug 08 02:31:24.351575 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 351/684] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:24 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:25.371389 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-032ab5d9-ca30-4864-b2cf-80ea454c5c2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:25.372026 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-032ab5d9-ca30-4864-b2cf-80ea454c5c2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:25.378669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-032ab5d9-ca30-4864-b2cf-80ea454c5c2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:25.379133 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-032ab5d9-ca30-4864-b2cf-80ea454c5c2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:25.379573 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-032ab5d9-ca30-4864-b2cf-80ea454c5c2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:25.380268 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-032ab5d9-ca30-4864-b2cf-80ea454c5c2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:25.380706 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-032ab5d9-ca30-4864-b2cf-80ea454c5c2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:25.381129 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-032ab5d9-ca30-4864-b2cf-80ea454c5c2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:25.529204 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-032ab5d9-ca30-4864-b2cf-80ea454c5c2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:25.538744 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-032ab5d9-ca30-4864-b2cf-80ea454c5c2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1357 microversion: 2.1 time: 0.171045 Aug 08 02:31:25.539457 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 334/685] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:25 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:26.558395 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b475691a-07f6-4eb3-881b-8207049ba933 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:26.559009 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b475691a-07f6-4eb3-881b-8207049ba933 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:26.565810 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b475691a-07f6-4eb3-881b-8207049ba933 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:26.566350 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b475691a-07f6-4eb3-881b-8207049ba933 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:26.570915 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b475691a-07f6-4eb3-881b-8207049ba933 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:26.571664 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b475691a-07f6-4eb3-881b-8207049ba933 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:26.572125 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b475691a-07f6-4eb3-881b-8207049ba933 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:26.572551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b475691a-07f6-4eb3-881b-8207049ba933 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:26.696843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b475691a-07f6-4eb3-881b-8207049ba933 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:26.704790 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b475691a-07f6-4eb3-881b-8207049ba933 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1546 microversion: 2.1 time: 0.149786 Aug 08 02:31:26.705344 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 352/686] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:26 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:26.724891 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-385b0faf-553c-43d2-86d8-5ad19103e1e5 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:26.725511 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-385b0faf-553c-43d2-86d8-5ad19103e1e5 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:26.731920 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-385b0faf-553c-43d2-86d8-5ad19103e1e5 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:26.732406 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-385b0faf-553c-43d2-86d8-5ad19103e1e5 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:26.732873 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-385b0faf-553c-43d2-86d8-5ad19103e1e5 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:26.733561 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-385b0faf-553c-43d2-86d8-5ad19103e1e5 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:26.734013 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-385b0faf-553c-43d2-86d8-5ad19103e1e5 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:26.734475 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-385b0faf-553c-43d2-86d8-5ad19103e1e5 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:26.858570 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-385b0faf-553c-43d2-86d8-5ad19103e1e5 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:26.865963 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-385b0faf-553c-43d2-86d8-5ad19103e1e5 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1546 microversion: 2.1 time: 0.144900 Aug 08 02:31:26.866564 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 335/687] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:26 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1546 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:26.884957 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3c4f24bc-c46b-4f7e-9831-89c1603cd08a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:26.889591 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3c4f24bc-c46b-4f7e-9831-89c1603cd08a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:26.890391 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3c4f24bc-c46b-4f7e-9831-89c1603cd08a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Searching by: {'deleted': False, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd'} {{(pid=117640) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 08 02:31:26.897377 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c4f24bc-c46b-4f7e-9831-89c1603cd08a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:26.897850 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c4f24bc-c46b-4f7e-9831-89c1603cd08a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:26.898314 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c4f24bc-c46b-4f7e-9831-89c1603cd08a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:26.899036 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c4f24bc-c46b-4f7e-9831-89c1603cd08a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:26.899487 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c4f24bc-c46b-4f7e-9831-89c1603cd08a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:26.899907 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c4f24bc-c46b-4f7e-9831-89c1603cd08a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:26.988525 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.multi_cell_list [None req-3c4f24bc-c46b-4f7e-9831-89c1603cd08a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117640) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 08 02:31:27.083707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3c4f24bc-c46b-4f7e-9831-89c1603cd08a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202400 Aug 08 02:31:27.084278 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 353/688] 10.222.0.39 () {58 vars in 1125 bytes} [Mon Aug 8 02:31:26 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:31:27.095366 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7fcb1647-9b2e-4ea0-a41e-ad4ce2907e14 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:27.096099 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7fcb1647-9b2e-4ea0-a41e-ad4ce2907e14 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:27.101973 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7fcb1647-9b2e-4ea0-a41e-ad4ce2907e14 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:27.102485 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7fcb1647-9b2e-4ea0-a41e-ad4ce2907e14 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:27.102923 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7fcb1647-9b2e-4ea0-a41e-ad4ce2907e14 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:27.103604 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7fcb1647-9b2e-4ea0-a41e-ad4ce2907e14 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:27.104052 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7fcb1647-9b2e-4ea0-a41e-ad4ce2907e14 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:27.104472 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7fcb1647-9b2e-4ea0-a41e-ad4ce2907e14 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:27.232511 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7fcb1647-9b2e-4ea0-a41e-ad4ce2907e14 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:27.239924 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7fcb1647-9b2e-4ea0-a41e-ad4ce2907e14 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1546 microversion: 2.1 time: 0.148403 Aug 08 02:31:27.240428 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 336/689] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:27 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:31.916855 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-07f99b29-c6c7-47c0-9b74-9f7f3f4a2c19 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55f3458c-147f-4af4-81e4-a58ffc1ac0db"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:31:31.919196 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-07f99b29-c6c7-47c0-9b74-9f7f3f4a2c19 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:31.925539 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-07f99b29-c6c7-47c0-9b74-9f7f3f4a2c19 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:31.926008 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-07f99b29-c6c7-47c0-9b74-9f7f3f4a2c19 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:31.926477 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-07f99b29-c6c7-47c0-9b74-9f7f3f4a2c19 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:31.927151 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-07f99b29-c6c7-47c0-9b74-9f7f3f4a2c19 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:31.927595 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-07f99b29-c6c7-47c0-9b74-9f7f3f4a2c19 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:31.928008 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-07f99b29-c6c7-47c0-9b74-9f7f3f4a2c19 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:32.200562 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-07f99b29-c6c7-47c0-9b74-9f7f3f4a2c19 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "POST /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287500 Aug 08 02:31:32.202385 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 354/690] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:31:31 2022] POST /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:31:40.835063 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-89ec3d09-41f2-4d5b-8b32-9f97f55d4695 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:40.835681 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-89ec3d09-41f2-4d5b-8b32-9f97f55d4695 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:40.838341 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=11 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:40.839101 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:40.844015 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89ec3d09-41f2-4d5b-8b32-9f97f55d4695 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:40.844550 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89ec3d09-41f2-4d5b-8b32-9f97f55d4695 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:40.844988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89ec3d09-41f2-4d5b-8b32-9f97f55d4695 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:40.846217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89ec3d09-41f2-4d5b-8b32-9f97f55d4695 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:40.846695 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89ec3d09-41f2-4d5b-8b32-9f97f55d4695 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:40.847114 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89ec3d09-41f2-4d5b-8b32-9f97f55d4695 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:40.975040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-89ec3d09-41f2-4d5b-8b32-9f97f55d4695 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:40.982825 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-89ec3d09-41f2-4d5b-8b32-9f97f55d4695 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1592 microversion: 2.1 time: 0.151535 Aug 08 02:31:40.983401 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 337/691] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:40 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1592 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:42.606622 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:42.607818 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=11 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:42.608831 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:31:42.664480 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-7ea93b3b-574b-46cd-9451-9b0ebe86e07c req-6630c5da-3cfb-4daf-bec9-39eb0ec3e5ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80280a99-0ab1-4981-96ff-9bebd5488772", "tag": "0cf66020-aef8-4e07-8464-3cd2cc846c95"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:31:42.677574 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-7ea93b3b-574b-46cd-9451-9b0ebe86e07c req-6630c5da-3cfb-4daf-bec9-39eb0ec3e5ef service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:42.678088 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-7ea93b3b-574b-46cd-9451-9b0ebe86e07c req-6630c5da-3cfb-4daf-bec9-39eb0ec3e5ef service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:42.678478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-7ea93b3b-574b-46cd-9451-9b0ebe86e07c req-6630c5da-3cfb-4daf-bec9-39eb0ec3e5ef service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:42.691928 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-7ea93b3b-574b-46cd-9451-9b0ebe86e07c req-6630c5da-3cfb-4daf-bec9-39eb0ec3e5ef service nova] Creating event network-changed:0cf66020-aef8-4e07-8464-3cd2cc846c95 for instance 80280a99-0ab1-4981-96ff-9bebd5488772 on hv-cinder-73306 Aug 08 02:31:42.697791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-7ea93b3b-574b-46cd-9451-9b0ebe86e07c req-6630c5da-3cfb-4daf-bec9-39eb0ec3e5ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096789 Aug 08 02:31:42.698865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 355/692] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:31:43.854937 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2e72b6dd-da2f-470b-a573-40c6a156b973 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1794644085"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:31:43.855479 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2e72b6dd-da2f-470b-a573-40c6a156b973 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:43.861958 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e72b6dd-da2f-470b-a573-40c6a156b973 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:43.862612 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e72b6dd-da2f-470b-a573-40c6a156b973 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:43.863058 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e72b6dd-da2f-470b-a573-40c6a156b973 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:43.863745 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e72b6dd-da2f-470b-a573-40c6a156b973 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:43.864241 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e72b6dd-da2f-470b-a573-40c6a156b973 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:43.864669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e72b6dd-da2f-470b-a573-40c6a156b973 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:44.001518 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.network.security_group_api [None req-2e72b6dd-da2f-470b-a573-40c6a156b973 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Adding security group 86e2b708-c853-4777-baf0-eff8726eaf39 to port 0cf66020-aef8-4e07-8464-3cd2cc846c95 Aug 08 02:31:44.329983 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2e72b6dd-da2f-470b-a573-40c6a156b973 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "POST /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/action" status: 202 len: 0 microversion: 2.1 time: 0.479057 Aug 08 02:31:44.330784 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 338/693] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:31:43 2022] POST /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:31:44.339456 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e025d88d-2f8e-43b7-8952-7336873ad1d3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:31:44.340146 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e025d88d-2f8e-43b7-8952-7336873ad1d3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:44.347361 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e025d88d-2f8e-43b7-8952-7336873ad1d3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:44.347837 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e025d88d-2f8e-43b7-8952-7336873ad1d3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:44.348277 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e025d88d-2f8e-43b7-8952-7336873ad1d3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:44.348947 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e025d88d-2f8e-43b7-8952-7336873ad1d3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:44.349458 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e025d88d-2f8e-43b7-8952-7336873ad1d3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:44.349885 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e025d88d-2f8e-43b7-8952-7336873ad1d3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:44.498930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e025d88d-2f8e-43b7-8952-7336873ad1d3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:31:44.507144 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e025d88d-2f8e-43b7-8952-7336873ad1d3 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1758 microversion: 2.1 time: 0.171772 Aug 08 02:31:44.507715 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 356/694] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:31:44 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:31:44.713979 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-eff8a2be-07fc-4294-b686-80617810b250 req-5e40463d-588d-442e-ad01-5740f05fffb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80280a99-0ab1-4981-96ff-9bebd5488772", "tag": "0cf66020-aef8-4e07-8464-3cd2cc846c95"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:31:44.727536 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-eff8a2be-07fc-4294-b686-80617810b250 req-5e40463d-588d-442e-ad01-5740f05fffb3 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:44.728010 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-eff8a2be-07fc-4294-b686-80617810b250 req-5e40463d-588d-442e-ad01-5740f05fffb3 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:44.728655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-eff8a2be-07fc-4294-b686-80617810b250 req-5e40463d-588d-442e-ad01-5740f05fffb3 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:44.740998 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-eff8a2be-07fc-4294-b686-80617810b250 req-5e40463d-588d-442e-ad01-5740f05fffb3 service nova] Creating event network-changed:0cf66020-aef8-4e07-8464-3cd2cc846c95 for instance 80280a99-0ab1-4981-96ff-9bebd5488772 on hv-cinder-73306 Aug 08 02:31:44.747653 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-eff8a2be-07fc-4294-b686-80617810b250 req-5e40463d-588d-442e-ad01-5740f05fffb3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037098 Aug 08 02:31:44.748257 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 339/695] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:31:53.193761 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0764e2c0-7732-4efd-9283-b43214db00da tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65295624-76f4-4767-ac3f-9b9eb1728076"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:31:53.196161 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0764e2c0-7732-4efd-9283-b43214db00da tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:31:53.204006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0764e2c0-7732-4efd-9283-b43214db00da tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:53.204556 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0764e2c0-7732-4efd-9283-b43214db00da tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:53.205059 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0764e2c0-7732-4efd-9283-b43214db00da tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:53.205746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0764e2c0-7732-4efd-9283-b43214db00da tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:31:53.206196 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0764e2c0-7732-4efd-9283-b43214db00da tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:31:53.206639 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0764e2c0-7732-4efd-9283-b43214db00da tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:31:53.471325 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0764e2c0-7732-4efd-9283-b43214db00da tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "POST /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.495305 Aug 08 02:31:53.471918 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 357/696] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:31:52 2022] POST /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments => generated 194 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:00.984081 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bc7cc7fe-25e7-435a-87c9-8364e8fe6a1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:00.986337 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bc7cc7fe-25e7-435a-87c9-8364e8fe6a1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:00.989638 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:00.990297 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=12 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:00.996015 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc7cc7fe-25e7-435a-87c9-8364e8fe6a1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:00.996487 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc7cc7fe-25e7-435a-87c9-8364e8fe6a1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:00.996915 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc7cc7fe-25e7-435a-87c9-8364e8fe6a1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:00.997599 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc7cc7fe-25e7-435a-87c9-8364e8fe6a1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:00.998044 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc7cc7fe-25e7-435a-87c9-8364e8fe6a1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:00.998488 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc7cc7fe-25e7-435a-87c9-8364e8fe6a1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:01.020626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-bc7cc7fe-25e7-435a-87c9-8364e8fe6a1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lazy-loading 'flavor' on Instance uuid 62da7e2f-df45-473c-bdee-84d29c6ccfcf {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:32:01.136323 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bc7cc7fe-25e7-435a-87c9-8364e8fe6a1e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "POST /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/action" status: 200 len: 32 microversion: 2.1 time: 0.156232 Aug 08 02:32:01.136844 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 340/697] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:32:00 2022] POST /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:32:01.147973 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0f059e49-f22e-4bc4-b5a3-6b40b33ec7c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:01.148663 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0f059e49-f22e-4bc4-b5a3-6b40b33ec7c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:01.154787 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0f059e49-f22e-4bc4-b5a3-6b40b33ec7c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:01.155259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0f059e49-f22e-4bc4-b5a3-6b40b33ec7c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:01.155681 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0f059e49-f22e-4bc4-b5a3-6b40b33ec7c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:01.156360 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0f059e49-f22e-4bc4-b5a3-6b40b33ec7c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:01.156800 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0f059e49-f22e-4bc4-b5a3-6b40b33ec7c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:01.157212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0f059e49-f22e-4bc4-b5a3-6b40b33ec7c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:01.367140 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0f059e49-f22e-4bc4-b5a3-6b40b33ec7c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:01.375092 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0f059e49-f22e-4bc4-b5a3-6b40b33ec7c5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.232347 Aug 08 02:32:01.375655 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 358/698] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:01 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:02.396787 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2cd63f9a-4fe8-4497-9862-df3c7b3b7d1b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:02.397516 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2cd63f9a-4fe8-4497-9862-df3c7b3b7d1b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:02.403725 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cd63f9a-4fe8-4497-9862-df3c7b3b7d1b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:02.404202 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cd63f9a-4fe8-4497-9862-df3c7b3b7d1b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:02.404632 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cd63f9a-4fe8-4497-9862-df3c7b3b7d1b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:02.405314 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cd63f9a-4fe8-4497-9862-df3c7b3b7d1b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:02.405764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cd63f9a-4fe8-4497-9862-df3c7b3b7d1b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:02.406183 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2cd63f9a-4fe8-4497-9862-df3c7b3b7d1b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:02.534843 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2cd63f9a-4fe8-4497-9862-df3c7b3b7d1b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:02.542841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2cd63f9a-4fe8-4497-9862-df3c7b3b7d1b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.150706 Aug 08 02:32:02.543404 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 341/699] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:02 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:03.563865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3c5d5400-af9f-4d13-9848-e33251f15669 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:03.564468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3c5d5400-af9f-4d13-9848-e33251f15669 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:03.571796 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c5d5400-af9f-4d13-9848-e33251f15669 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:03.572269 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c5d5400-af9f-4d13-9848-e33251f15669 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:03.572696 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c5d5400-af9f-4d13-9848-e33251f15669 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:03.573373 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c5d5400-af9f-4d13-9848-e33251f15669 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:03.573816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c5d5400-af9f-4d13-9848-e33251f15669 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:03.574232 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c5d5400-af9f-4d13-9848-e33251f15669 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:03.718691 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3c5d5400-af9f-4d13-9848-e33251f15669 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:03.727476 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3c5d5400-af9f-4d13-9848-e33251f15669 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.167428 Aug 08 02:32:03.728041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 359/700] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:03 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:03.776784 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2298d7bc-9248-413d-8d9f-01b048651492 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:03.777367 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2298d7bc-9248-413d-8d9f-01b048651492 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:03.783148 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2298d7bc-9248-413d-8d9f-01b048651492 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:03.783626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2298d7bc-9248-413d-8d9f-01b048651492 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:03.784055 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2298d7bc-9248-413d-8d9f-01b048651492 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:03.785257 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2298d7bc-9248-413d-8d9f-01b048651492 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:03.785702 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2298d7bc-9248-413d-8d9f-01b048651492 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:03.786116 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2298d7bc-9248-413d-8d9f-01b048651492 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:03.865072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-2298d7bc-9248-413d-8d9f-01b048651492 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lazy-loading 'services' on Instance uuid 2a61fcac-cea3-4e95-a463-bb2f44b28e39 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:32:03.933733 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2298d7bc-9248-413d-8d9f-01b048651492 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/os-volume_attachments/04cb6773-0379-43cb-812f-c147c4e454bb" status: 202 len: 0 microversion: 2.1 time: 0.264518 Aug 08 02:32:03.934624 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 342/701] 10.222.0.39 () {58 vars in 1416 bytes} [Mon Aug 8 02:32:03 2022] DELETE /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/os-volume_attachments/04cb6773-0379-43cb-812f-c147c4e454bb => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:32:04.748744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1eeb620b-8f9e-499a-9e65-ae2c2ff356e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:04.749381 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1eeb620b-8f9e-499a-9e65-ae2c2ff356e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:04.756141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1eeb620b-8f9e-499a-9e65-ae2c2ff356e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:04.756620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1eeb620b-8f9e-499a-9e65-ae2c2ff356e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:04.757050 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1eeb620b-8f9e-499a-9e65-ae2c2ff356e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:04.757733 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1eeb620b-8f9e-499a-9e65-ae2c2ff356e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:04.758179 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1eeb620b-8f9e-499a-9e65-ae2c2ff356e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:04.758623 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1eeb620b-8f9e-499a-9e65-ae2c2ff356e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:04.890038 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1eeb620b-8f9e-499a-9e65-ae2c2ff356e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:04.898042 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1eeb620b-8f9e-499a-9e65-ae2c2ff356e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.153081 Aug 08 02:32:04.898625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 360/702] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:04 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:05.058966 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-05ffbf9d-bf75-446f-bdaa-d9844686f0d0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:05.065422 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05ffbf9d-bf75-446f-bdaa-d9844686f0d0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:05.065892 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05ffbf9d-bf75-446f-bdaa-d9844686f0d0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:05.066956 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05ffbf9d-bf75-446f-bdaa-d9844686f0d0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:05.087915 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-05ffbf9d-bf75-446f-bdaa-d9844686f0d0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Going to try to stop instance {{(pid=117642) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 02:32:05.127575 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-05ffbf9d-bf75-446f-bdaa-d9844686f0d0 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "POST /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/action" status: 202 len: 0 microversion: 2.1 time: 0.073126 Aug 08 02:32:05.128342 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 343/703] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:32:05 2022] POST /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:32:05.136801 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-83865136-6b51-4202-b649-124dacaa56ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:05.137402 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-83865136-6b51-4202-b649-124dacaa56ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:05.143299 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-83865136-6b51-4202-b649-124dacaa56ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:05.143777 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-83865136-6b51-4202-b649-124dacaa56ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:05.144201 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-83865136-6b51-4202-b649-124dacaa56ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:05.144999 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-83865136-6b51-4202-b649-124dacaa56ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:05.145447 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-83865136-6b51-4202-b649-124dacaa56ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:05.145859 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-83865136-6b51-4202-b649-124dacaa56ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:05.275637 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-83865136-6b51-4202-b649-124dacaa56ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:05.283004 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-83865136-6b51-4202-b649-124dacaa56ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.149951 Aug 08 02:32:05.283561 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 361/704] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:05 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:05.919750 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5906c521-b488-4bbe-aaf0-df0937cf6a3a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:05.920452 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5906c521-b488-4bbe-aaf0-df0937cf6a3a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:05.926657 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5906c521-b488-4bbe-aaf0-df0937cf6a3a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:05.927141 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5906c521-b488-4bbe-aaf0-df0937cf6a3a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:05.927574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5906c521-b488-4bbe-aaf0-df0937cf6a3a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:05.928255 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5906c521-b488-4bbe-aaf0-df0937cf6a3a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:05.928706 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5906c521-b488-4bbe-aaf0-df0937cf6a3a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:05.929127 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5906c521-b488-4bbe-aaf0-df0937cf6a3a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:06.058907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5906c521-b488-4bbe-aaf0-df0937cf6a3a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:06.068147 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5906c521-b488-4bbe-aaf0-df0937cf6a3a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.152579 Aug 08 02:32:06.068738 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 344/705] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:05 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:06.304562 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8344946e-df78-44d1-8c65-ff17dc6cc68c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:06.305169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8344946e-df78-44d1-8c65-ff17dc6cc68c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:06.311512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8344946e-df78-44d1-8c65-ff17dc6cc68c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:06.311984 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8344946e-df78-44d1-8c65-ff17dc6cc68c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:06.312409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8344946e-df78-44d1-8c65-ff17dc6cc68c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:06.313081 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8344946e-df78-44d1-8c65-ff17dc6cc68c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:06.313525 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8344946e-df78-44d1-8c65-ff17dc6cc68c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:06.313942 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8344946e-df78-44d1-8c65-ff17dc6cc68c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:06.444755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8344946e-df78-44d1-8c65-ff17dc6cc68c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:06.452260 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8344946e-df78-44d1-8c65-ff17dc6cc68c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.151941 Aug 08 02:32:06.452818 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 362/706] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:06 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:07.089168 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fbf78c0e-e703-4cc4-a9d7-f0c127ff82c3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:07.089782 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fbf78c0e-e703-4cc4-a9d7-f0c127ff82c3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:07.096114 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fbf78c0e-e703-4cc4-a9d7-f0c127ff82c3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:07.096595 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fbf78c0e-e703-4cc4-a9d7-f0c127ff82c3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:07.097030 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fbf78c0e-e703-4cc4-a9d7-f0c127ff82c3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:07.097712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fbf78c0e-e703-4cc4-a9d7-f0c127ff82c3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:07.098163 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fbf78c0e-e703-4cc4-a9d7-f0c127ff82c3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:07.098627 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fbf78c0e-e703-4cc4-a9d7-f0c127ff82c3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:07.224730 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fbf78c0e-e703-4cc4-a9d7-f0c127ff82c3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:07.232539 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fbf78c0e-e703-4cc4-a9d7-f0c127ff82c3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.147288 Aug 08 02:32:07.233102 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 345/707] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:07 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:07.473567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ddff0807-4c0d-439a-b385-21d49246ca46 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:07.474205 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ddff0807-4c0d-439a-b385-21d49246ca46 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:07.480594 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ddff0807-4c0d-439a-b385-21d49246ca46 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:07.481070 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ddff0807-4c0d-439a-b385-21d49246ca46 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:07.481500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ddff0807-4c0d-439a-b385-21d49246ca46 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:07.482178 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ddff0807-4c0d-439a-b385-21d49246ca46 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:07.482728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ddff0807-4c0d-439a-b385-21d49246ca46 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:07.483148 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ddff0807-4c0d-439a-b385-21d49246ca46 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:07.609178 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ddff0807-4c0d-439a-b385-21d49246ca46 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:07.617120 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ddff0807-4c0d-439a-b385-21d49246ca46 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.147881 Aug 08 02:32:07.617677 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 363/708] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:07 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:08.253968 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c1ba8148-4d89-4ce3-8586-a0c7a9157134 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:08.254605 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c1ba8148-4d89-4ce3-8586-a0c7a9157134 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:08.261405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ba8148-4d89-4ce3-8586-a0c7a9157134 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:08.261888 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ba8148-4d89-4ce3-8586-a0c7a9157134 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:08.262356 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ba8148-4d89-4ce3-8586-a0c7a9157134 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:08.263045 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ba8148-4d89-4ce3-8586-a0c7a9157134 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:08.263497 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ba8148-4d89-4ce3-8586-a0c7a9157134 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:08.263920 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ba8148-4d89-4ce3-8586-a0c7a9157134 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:08.396414 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c1ba8148-4d89-4ce3-8586-a0c7a9157134 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:08.404276 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c1ba8148-4d89-4ce3-8586-a0c7a9157134 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.154203 Aug 08 02:32:08.404846 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 346/709] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:08 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:08.638500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3bfd3718-178e-4c56-9a11-a6cd80f2b3af tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:08.639110 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3bfd3718-178e-4c56-9a11-a6cd80f2b3af tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:08.646088 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3bfd3718-178e-4c56-9a11-a6cd80f2b3af tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:08.646599 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3bfd3718-178e-4c56-9a11-a6cd80f2b3af tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:08.647036 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3bfd3718-178e-4c56-9a11-a6cd80f2b3af tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:08.647726 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3bfd3718-178e-4c56-9a11-a6cd80f2b3af tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:08.648177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3bfd3718-178e-4c56-9a11-a6cd80f2b3af tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:08.648600 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3bfd3718-178e-4c56-9a11-a6cd80f2b3af tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:08.778431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3bfd3718-178e-4c56-9a11-a6cd80f2b3af tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:08.785842 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3bfd3718-178e-4c56-9a11-a6cd80f2b3af tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.151199 Aug 08 02:32:08.787066 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 364/710] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:08 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:09.425546 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c5419b42-ce77-4b88-b7c3-39ca6a87ed1f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:09.426187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c5419b42-ce77-4b88-b7c3-39ca6a87ed1f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:09.433095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5419b42-ce77-4b88-b7c3-39ca6a87ed1f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:09.433573 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5419b42-ce77-4b88-b7c3-39ca6a87ed1f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:09.434007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5419b42-ce77-4b88-b7c3-39ca6a87ed1f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:09.434713 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5419b42-ce77-4b88-b7c3-39ca6a87ed1f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:09.435168 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5419b42-ce77-4b88-b7c3-39ca6a87ed1f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:09.435591 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5419b42-ce77-4b88-b7c3-39ca6a87ed1f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:09.565267 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c5419b42-ce77-4b88-b7c3-39ca6a87ed1f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:09.574465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c5419b42-ce77-4b88-b7c3-39ca6a87ed1f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.152610 Aug 08 02:32:09.575101 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 347/711] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:09 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:09.807760 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-193d18cb-b00f-4ba8-9ae2-feedd6cd447e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:09.808362 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-193d18cb-b00f-4ba8-9ae2-feedd6cd447e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:09.814695 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-193d18cb-b00f-4ba8-9ae2-feedd6cd447e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:09.815419 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-193d18cb-b00f-4ba8-9ae2-feedd6cd447e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:09.815846 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-193d18cb-b00f-4ba8-9ae2-feedd6cd447e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:09.816514 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-193d18cb-b00f-4ba8-9ae2-feedd6cd447e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:09.816953 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-193d18cb-b00f-4ba8-9ae2-feedd6cd447e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:09.817364 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-193d18cb-b00f-4ba8-9ae2-feedd6cd447e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:09.944442 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-193d18cb-b00f-4ba8-9ae2-feedd6cd447e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:09.952041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-193d18cb-b00f-4ba8-9ae2-feedd6cd447e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.148116 Aug 08 02:32:09.952607 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 365/712] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:09 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:10.597082 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0c0256b6-0b9b-42e7-b9a4-517078ef2bb3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:10.597757 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0c0256b6-0b9b-42e7-b9a4-517078ef2bb3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:10.604861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c0256b6-0b9b-42e7-b9a4-517078ef2bb3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:10.605352 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c0256b6-0b9b-42e7-b9a4-517078ef2bb3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:10.605786 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c0256b6-0b9b-42e7-b9a4-517078ef2bb3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:10.606595 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c0256b6-0b9b-42e7-b9a4-517078ef2bb3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:10.607055 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c0256b6-0b9b-42e7-b9a4-517078ef2bb3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:10.607479 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c0256b6-0b9b-42e7-b9a4-517078ef2bb3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:10.735825 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0c0256b6-0b9b-42e7-b9a4-517078ef2bb3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:10.744299 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0c0256b6-0b9b-42e7-b9a4-517078ef2bb3 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.151183 Aug 08 02:32:10.744863 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 348/713] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:10 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:10.974219 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6fe28125-4ce6-4c4e-8f90-87aec875500d tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:10.974846 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6fe28125-4ce6-4c4e-8f90-87aec875500d tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:10.981161 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6fe28125-4ce6-4c4e-8f90-87aec875500d tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:10.981632 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6fe28125-4ce6-4c4e-8f90-87aec875500d tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:10.982054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6fe28125-4ce6-4c4e-8f90-87aec875500d tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:10.982753 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6fe28125-4ce6-4c4e-8f90-87aec875500d tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:10.983201 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6fe28125-4ce6-4c4e-8f90-87aec875500d tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:10.983667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6fe28125-4ce6-4c4e-8f90-87aec875500d tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:11.107405 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6fe28125-4ce6-4c4e-8f90-87aec875500d tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:11.114685 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6fe28125-4ce6-4c4e-8f90-87aec875500d tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.144867 Aug 08 02:32:11.115240 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 366/714] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:10 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:11.764786 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-770b1aa3-1ae0-49e7-88d4-40153d2e3a81 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:11.765389 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-770b1aa3-1ae0-49e7-88d4-40153d2e3a81 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:11.772247 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-770b1aa3-1ae0-49e7-88d4-40153d2e3a81 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:11.772718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-770b1aa3-1ae0-49e7-88d4-40153d2e3a81 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:11.773144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-770b1aa3-1ae0-49e7-88d4-40153d2e3a81 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:11.773819 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-770b1aa3-1ae0-49e7-88d4-40153d2e3a81 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:11.774283 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-770b1aa3-1ae0-49e7-88d4-40153d2e3a81 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:11.774705 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-770b1aa3-1ae0-49e7-88d4-40153d2e3a81 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:11.904293 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-770b1aa3-1ae0-49e7-88d4-40153d2e3a81 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:11.912592 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-770b1aa3-1ae0-49e7-88d4-40153d2e3a81 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.151654 Aug 08 02:32:11.913151 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 349/715] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:11 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:12.135622 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1c01c89d-0811-490e-817a-afd10a276eb2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:12.136237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1c01c89d-0811-490e-817a-afd10a276eb2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:12.142667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c01c89d-0811-490e-817a-afd10a276eb2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:12.143137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c01c89d-0811-490e-817a-afd10a276eb2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:12.143562 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c01c89d-0811-490e-817a-afd10a276eb2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:12.144237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c01c89d-0811-490e-817a-afd10a276eb2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:12.144684 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c01c89d-0811-490e-817a-afd10a276eb2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:12.145101 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c01c89d-0811-490e-817a-afd10a276eb2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:12.274987 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1c01c89d-0811-490e-817a-afd10a276eb2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:12.282258 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1c01c89d-0811-490e-817a-afd10a276eb2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.150471 Aug 08 02:32:12.282839 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 367/716] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:12 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:12.933754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1425aeb7-03c3-4f48-b27e-cd5b3a480800 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:12.934386 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1425aeb7-03c3-4f48-b27e-cd5b3a480800 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:12.940705 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1425aeb7-03c3-4f48-b27e-cd5b3a480800 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:12.941173 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1425aeb7-03c3-4f48-b27e-cd5b3a480800 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:12.941596 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1425aeb7-03c3-4f48-b27e-cd5b3a480800 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:12.942342 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1425aeb7-03c3-4f48-b27e-cd5b3a480800 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:12.942791 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1425aeb7-03c3-4f48-b27e-cd5b3a480800 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:12.943207 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1425aeb7-03c3-4f48-b27e-cd5b3a480800 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:13.069933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1425aeb7-03c3-4f48-b27e-cd5b3a480800 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:13.077834 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1425aeb7-03c3-4f48-b27e-cd5b3a480800 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.147968 Aug 08 02:32:13.078429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 350/717] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:12 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:13.303253 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ed51cfd7-e5c6-491a-abd5-856f241513dd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:13.303859 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ed51cfd7-e5c6-491a-abd5-856f241513dd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:13.306442 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=27 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:13.311570 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ed51cfd7-e5c6-491a-abd5-856f241513dd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:13.312041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ed51cfd7-e5c6-491a-abd5-856f241513dd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:13.312473 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ed51cfd7-e5c6-491a-abd5-856f241513dd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:13.313150 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ed51cfd7-e5c6-491a-abd5-856f241513dd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:13.313595 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ed51cfd7-e5c6-491a-abd5-856f241513dd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:13.314011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ed51cfd7-e5c6-491a-abd5-856f241513dd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:13.319012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:13.444114 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ed51cfd7-e5c6-491a-abd5-856f241513dd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:13.451710 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ed51cfd7-e5c6-491a-abd5-856f241513dd tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.152792 Aug 08 02:32:13.452266 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 368/718] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:13 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:14.099537 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8c398194-76c3-4f2e-8a0c-404a4d368bfb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:14.100069 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8c398194-76c3-4f2e-8a0c-404a4d368bfb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:14.106440 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c398194-76c3-4f2e-8a0c-404a4d368bfb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:14.106922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c398194-76c3-4f2e-8a0c-404a4d368bfb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:14.107357 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c398194-76c3-4f2e-8a0c-404a4d368bfb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:14.108042 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c398194-76c3-4f2e-8a0c-404a4d368bfb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:14.108500 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c398194-76c3-4f2e-8a0c-404a4d368bfb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:14.108919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c398194-76c3-4f2e-8a0c-404a4d368bfb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:14.233828 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8c398194-76c3-4f2e-8a0c-404a4d368bfb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:14.241621 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8c398194-76c3-4f2e-8a0c-404a4d368bfb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.146642 Aug 08 02:32:14.242188 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 351/719] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:14 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:14.472325 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-01ba8734-6ec9-482c-9f7c-bf23a29aa9ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:14.472924 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-01ba8734-6ec9-482c-9f7c-bf23a29aa9ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:14.479416 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01ba8734-6ec9-482c-9f7c-bf23a29aa9ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:14.479890 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01ba8734-6ec9-482c-9f7c-bf23a29aa9ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:14.480311 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01ba8734-6ec9-482c-9f7c-bf23a29aa9ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:14.480983 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01ba8734-6ec9-482c-9f7c-bf23a29aa9ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:14.481427 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01ba8734-6ec9-482c-9f7c-bf23a29aa9ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:14.481836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-01ba8734-6ec9-482c-9f7c-bf23a29aa9ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:14.613962 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-01ba8734-6ec9-482c-9f7c-bf23a29aa9ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:14.621873 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-01ba8734-6ec9-482c-9f7c-bf23a29aa9ee tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.153367 Aug 08 02:32:14.622476 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 369/720] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:14 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:15.262968 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c82a2f02-3a8e-416e-bd90-433dacae68a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:15.263585 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c82a2f02-3a8e-416e-bd90-433dacae68a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:15.269948 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c82a2f02-3a8e-416e-bd90-433dacae68a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:15.270962 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c82a2f02-3a8e-416e-bd90-433dacae68a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:15.271398 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c82a2f02-3a8e-416e-bd90-433dacae68a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:15.272079 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c82a2f02-3a8e-416e-bd90-433dacae68a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:15.272525 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c82a2f02-3a8e-416e-bd90-433dacae68a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:15.272953 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c82a2f02-3a8e-416e-bd90-433dacae68a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:15.402543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c82a2f02-3a8e-416e-bd90-433dacae68a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:15.405960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:15.411850 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c82a2f02-3a8e-416e-bd90-433dacae68a0 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.152164 Aug 08 02:32:15.412421 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 352/721] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:15 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:15.644069 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ef048018-6a58-456b-80c1-efc4454c7d24 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:15.644630 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ef048018-6a58-456b-80c1-efc4454c7d24 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:15.651492 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ef048018-6a58-456b-80c1-efc4454c7d24 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:15.651968 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ef048018-6a58-456b-80c1-efc4454c7d24 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:15.652398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ef048018-6a58-456b-80c1-efc4454c7d24 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:15.653084 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ef048018-6a58-456b-80c1-efc4454c7d24 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:15.653533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ef048018-6a58-456b-80c1-efc4454c7d24 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:15.653955 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ef048018-6a58-456b-80c1-efc4454c7d24 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:15.782560 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ef048018-6a58-456b-80c1-efc4454c7d24 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:15.789892 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ef048018-6a58-456b-80c1-efc4454c7d24 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.149785 Aug 08 02:32:15.790483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 370/722] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:15 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:15.980714 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:32:15.980910 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Mon Aug 8 02:32:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:32:16.433177 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-36ce8239-4db3-4770-8298-7dc45c4ac769 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:16.433840 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-36ce8239-4db3-4770-8298-7dc45c4ac769 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:16.442386 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-36ce8239-4db3-4770-8298-7dc45c4ac769 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:16.442867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-36ce8239-4db3-4770-8298-7dc45c4ac769 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:16.443299 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-36ce8239-4db3-4770-8298-7dc45c4ac769 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:16.443993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-36ce8239-4db3-4770-8298-7dc45c4ac769 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:16.444439 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-36ce8239-4db3-4770-8298-7dc45c4ac769 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:16.444857 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-36ce8239-4db3-4770-8298-7dc45c4ac769 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:16.575818 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-36ce8239-4db3-4770-8298-7dc45c4ac769 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:16.583751 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-36ce8239-4db3-4770-8298-7dc45c4ac769 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.154430 Aug 08 02:32:16.584305 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 353/723] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:16 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:16.810433 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-df4e4cb9-b5af-4739-9528-755eb566281a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:16.811046 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-df4e4cb9-b5af-4739-9528-755eb566281a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:16.817620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-df4e4cb9-b5af-4739-9528-755eb566281a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:16.818099 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-df4e4cb9-b5af-4739-9528-755eb566281a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:16.818559 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-df4e4cb9-b5af-4739-9528-755eb566281a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:16.819248 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-df4e4cb9-b5af-4739-9528-755eb566281a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:16.819701 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-df4e4cb9-b5af-4739-9528-755eb566281a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:16.820120 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-df4e4cb9-b5af-4739-9528-755eb566281a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:16.945753 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-df4e4cb9-b5af-4739-9528-755eb566281a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:16.953133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-df4e4cb9-b5af-4739-9528-755eb566281a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.146513 Aug 08 02:32:16.953685 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 371/724] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:16 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:17.604868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5d21121e-f87f-42af-bc5e-58d914d8cde7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:17.605471 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5d21121e-f87f-42af-bc5e-58d914d8cde7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:17.611780 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d21121e-f87f-42af-bc5e-58d914d8cde7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:17.612248 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d21121e-f87f-42af-bc5e-58d914d8cde7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:17.612670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d21121e-f87f-42af-bc5e-58d914d8cde7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:17.613342 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d21121e-f87f-42af-bc5e-58d914d8cde7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:17.613788 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d21121e-f87f-42af-bc5e-58d914d8cde7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:17.614728 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d21121e-f87f-42af-bc5e-58d914d8cde7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:17.745532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5d21121e-f87f-42af-bc5e-58d914d8cde7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:17.753321 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5d21121e-f87f-42af-bc5e-58d914d8cde7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.152330 Aug 08 02:32:17.753879 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 354/725] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:17 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:17.974456 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a9c0d225-9ea4-4541-8a5a-fe577fd6f8f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:17.974986 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a9c0d225-9ea4-4541-8a5a-fe577fd6f8f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:17.981297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9c0d225-9ea4-4541-8a5a-fe577fd6f8f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:17.981778 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9c0d225-9ea4-4541-8a5a-fe577fd6f8f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:17.982212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9c0d225-9ea4-4541-8a5a-fe577fd6f8f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:17.982911 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9c0d225-9ea4-4541-8a5a-fe577fd6f8f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:17.983359 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9c0d225-9ea4-4541-8a5a-fe577fd6f8f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:17.983780 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9c0d225-9ea4-4541-8a5a-fe577fd6f8f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:18.111594 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a9c0d225-9ea4-4541-8a5a-fe577fd6f8f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:18.119550 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a9c0d225-9ea4-4541-8a5a-fe577fd6f8f7 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.149549 Aug 08 02:32:18.120109 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 372/726] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:17 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:18.775580 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-04e57198-a367-4c73-99b8-fec908343f96 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:18.776185 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-04e57198-a367-4c73-99b8-fec908343f96 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:18.782671 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04e57198-a367-4c73-99b8-fec908343f96 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:18.783145 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04e57198-a367-4c73-99b8-fec908343f96 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:18.783570 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04e57198-a367-4c73-99b8-fec908343f96 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:18.784249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04e57198-a367-4c73-99b8-fec908343f96 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:18.784694 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04e57198-a367-4c73-99b8-fec908343f96 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:18.785108 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-04e57198-a367-4c73-99b8-fec908343f96 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:18.921508 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-04e57198-a367-4c73-99b8-fec908343f96 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:18.929547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-04e57198-a367-4c73-99b8-fec908343f96 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.157732 Aug 08 02:32:18.930129 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 355/727] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:18 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:19.140651 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7ab5838f-f928-4a3c-99d4-12bb908c69cf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:19.141284 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7ab5838f-f928-4a3c-99d4-12bb908c69cf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:19.147710 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7ab5838f-f928-4a3c-99d4-12bb908c69cf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:19.148178 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7ab5838f-f928-4a3c-99d4-12bb908c69cf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:19.148601 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7ab5838f-f928-4a3c-99d4-12bb908c69cf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:19.149270 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7ab5838f-f928-4a3c-99d4-12bb908c69cf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:19.149712 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7ab5838f-f928-4a3c-99d4-12bb908c69cf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:19.150124 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7ab5838f-f928-4a3c-99d4-12bb908c69cf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:19.280094 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7ab5838f-f928-4a3c-99d4-12bb908c69cf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:19.287481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7ab5838f-f928-4a3c-99d4-12bb908c69cf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.150657 Aug 08 02:32:19.288036 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 373/728] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:19 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:19.951941 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-26424340-b277-47d6-80f7-065c54b619e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:19.952580 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-26424340-b277-47d6-80f7-065c54b619e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:19.961405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26424340-b277-47d6-80f7-065c54b619e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:19.961405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26424340-b277-47d6-80f7-065c54b619e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:19.961405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26424340-b277-47d6-80f7-065c54b619e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:19.961405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26424340-b277-47d6-80f7-065c54b619e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:19.961848 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26424340-b277-47d6-80f7-065c54b619e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:19.962497 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26424340-b277-47d6-80f7-065c54b619e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:20.093457 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-26424340-b277-47d6-80f7-065c54b619e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:20.102010 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-26424340-b277-47d6-80f7-065c54b619e5 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1736 microversion: 2.1 time: 0.154361 Aug 08 02:32:20.102618 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 356/729] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:19 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:20.308331 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8c64bba7-54d3-45ab-a480-82413d9d65a8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:20.308876 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8c64bba7-54d3-45ab-a480-82413d9d65a8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:20.315722 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8c64bba7-54d3-45ab-a480-82413d9d65a8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:20.316210 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8c64bba7-54d3-45ab-a480-82413d9d65a8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:20.316645 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8c64bba7-54d3-45ab-a480-82413d9d65a8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:20.317835 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8c64bba7-54d3-45ab-a480-82413d9d65a8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:20.318310 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8c64bba7-54d3-45ab-a480-82413d9d65a8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:20.318740 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8c64bba7-54d3-45ab-a480-82413d9d65a8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:20.449184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8c64bba7-54d3-45ab-a480-82413d9d65a8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:20.456672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8c64bba7-54d3-45ab-a480-82413d9d65a8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1676 microversion: 2.1 time: 0.152395 Aug 08 02:32:20.457232 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 374/730] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:20 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:21.123525 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0f483249-404d-44ed-9120-129e15bcabe9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:21.124140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0f483249-404d-44ed-9120-129e15bcabe9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:21.130481 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f483249-404d-44ed-9120-129e15bcabe9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.130959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f483249-404d-44ed-9120-129e15bcabe9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.131389 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f483249-404d-44ed-9120-129e15bcabe9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.132077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f483249-404d-44ed-9120-129e15bcabe9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.132528 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f483249-404d-44ed-9120-129e15bcabe9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.132949 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f483249-404d-44ed-9120-129e15bcabe9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.273654 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0f483249-404d-44ed-9120-129e15bcabe9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:21.281663 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0f483249-404d-44ed-9120-129e15bcabe9 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1716 microversion: 2.1 time: 0.162451 Aug 08 02:32:21.282227 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 357/731] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:21 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:21.349538 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9ec262dc-c623-4541-b06c-6d098b9cfb69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:21.350151 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9ec262dc-c623-4541-b06c-6d098b9cfb69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:21.356571 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9ec262dc-c623-4541-b06c-6d098b9cfb69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.357048 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9ec262dc-c623-4541-b06c-6d098b9cfb69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.357481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9ec262dc-c623-4541-b06c-6d098b9cfb69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.358169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9ec262dc-c623-4541-b06c-6d098b9cfb69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.358651 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9ec262dc-c623-4541-b06c-6d098b9cfb69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.359079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9ec262dc-c623-4541-b06c-6d098b9cfb69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.478717 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fdc094a2-d2e7-4fab-badc-90138b291ba9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:21.479338 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fdc094a2-d2e7-4fab-badc-90138b291ba9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:21.481048 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-9ec262dc-c623-4541-b06c-6d098b9cfb69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] HTTP exception thrown: Cannot 'detach_volume' instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf while it is in vm_state rescued Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9ec262dc-c623-4541-b06c-6d098b9cfb69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Request method failure captured: Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: DELETE /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments/65295624-76f4-4767-ac3f-9b9eb1728076 HTTP/1.1 Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQj7nZ596tyWWWEdcaGznu-Z4Br4Pom5I2-PAdLAUN_l4GI5DRgq5KfI9Fl4w_rhUMWFPKnZ3O16ZNtof9AdmY2rGF26JlAQcLDANOgMx4S2l8JMiyb147J-pdIPWo7r6B24FrJ8_yahhcB2zBycszIcITthdplKZyyjWZU9pJnJXE Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 12bf9f0d74de4a57918b688a6d969b28 Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:32:21.482674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:32:21.484703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12bf9f0d74de4a57918b688a6d969b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12bf9f0d74de4a57918b688a6d969b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12bf9f0d74de4a57918b688a6d969b28", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12bf9f0d74de4a57918b688a6d969b28"}]}] Aug 08 02:32:21.484703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:32:21.484703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 12bf9f0d74de4a57918b688a6d969b28 Aug 08 02:32:21.484703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:32:21.484703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-ServerRescueNegativeTestJSON-561377719-project Aug 08 02:32:21.484703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:32:21.484703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:32:21.484703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 1fd1b40cbd884915bdfac150f9718e32 Aug 08 02:32:21.484703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-561377719-project Aug 08 02:32:21.484703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:32:21.484703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Cannot 'detach_volume' instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf while it is in vm_state rescued Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'server_id': '62da7e2f-df45-473c-bdee-84d29c6ccfcf', 'id': '65295624-76f4-4767-ac3f-9b9eb1728076'} Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:32:21.485853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf while it is in vm_state rescued Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf while it is in vm_state rescued Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:21.487398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9ec262dc-c623-4541-b06c-6d098b9cfb69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Returning 409 to user: Cannot 'detach_volume' instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf while it is in vm_state rescued {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:32:21.489523 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9ec262dc-c623-4541-b06c-6d098b9cfb69 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "DELETE /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments/65295624-76f4-4767-ac3f-9b9eb1728076" status: 409 len: 152 microversion: 2.1 time: 0.139143 Aug 08 02:32:21.489523 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 375/732] 10.222.0.39 () {58 vars in 1416 bytes} [Mon Aug 8 02:32:21 2022] DELETE /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments/65295624-76f4-4767-ac3f-9b9eb1728076 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 02:32:21.489819 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdc094a2-d2e7-4fab-badc-90138b291ba9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.489819 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdc094a2-d2e7-4fab-badc-90138b291ba9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.489819 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdc094a2-d2e7-4fab-badc-90138b291ba9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.489819 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdc094a2-d2e7-4fab-badc-90138b291ba9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.490362 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdc094a2-d2e7-4fab-badc-90138b291ba9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.490362 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fdc094a2-d2e7-4fab-badc-90138b291ba9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.495611 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1a14526d-baff-464a-9d4b-cc2f56ff2a49 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:21.496151 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1a14526d-baff-464a-9d4b-cc2f56ff2a49 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:21.501936 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a14526d-baff-464a-9d4b-cc2f56ff2a49 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.502455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a14526d-baff-464a-9d4b-cc2f56ff2a49 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.502896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a14526d-baff-464a-9d4b-cc2f56ff2a49 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.503590 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a14526d-baff-464a-9d4b-cc2f56ff2a49 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.504046 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a14526d-baff-464a-9d4b-cc2f56ff2a49 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.504513 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a14526d-baff-464a-9d4b-cc2f56ff2a49 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.570392 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1a14526d-baff-464a-9d4b-cc2f56ff2a49 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "POST /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/action" status: 202 len: 0 microversion: 2.1 time: 0.081247 Aug 08 02:32:21.574141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 376/733] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:32:21 2022] POST /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:32:21.579382 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e1ae9c61-a27d-476e-8c73-180d0fb7b388 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:21.580069 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e1ae9c61-a27d-476e-8c73-180d0fb7b388 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:21.586971 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e1ae9c61-a27d-476e-8c73-180d0fb7b388 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.587383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e1ae9c61-a27d-476e-8c73-180d0fb7b388 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.587869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e1ae9c61-a27d-476e-8c73-180d0fb7b388 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.588567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e1ae9c61-a27d-476e-8c73-180d0fb7b388 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.589018 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e1ae9c61-a27d-476e-8c73-180d0fb7b388 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.589538 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e1ae9c61-a27d-476e-8c73-180d0fb7b388 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.625215 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fdc094a2-d2e7-4fab-badc-90138b291ba9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:21.633114 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fdc094a2-d2e7-4fab-badc-90138b291ba9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1653 microversion: 2.1 time: 0.158176 Aug 08 02:32:21.633903 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 358/734] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:21 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1653 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:21.654953 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2d3360de-ad6f-4bd3-92c6-e716a070f863 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:21.661733 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d3360de-ad6f-4bd3-92c6-e716a070f863 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.662226 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d3360de-ad6f-4bd3-92c6-e716a070f863 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.662691 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d3360de-ad6f-4bd3-92c6-e716a070f863 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.685226 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2d3360de-ad6f-4bd3-92c6-e716a070f863 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Going to try to start instance {{(pid=117642) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 02:32:21.731476 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2d3360de-ad6f-4bd3-92c6-e716a070f863 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "POST /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/action" status: 202 len: 0 microversion: 2.1 time: 0.080196 Aug 08 02:32:21.732282 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 359/735] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:32:21 2022] POST /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:32:21.741729 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-960e52a0-e756-4b02-9ab7-35be02df0100 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:21.742471 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-960e52a0-e756-4b02-9ab7-35be02df0100 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:21.749664 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-960e52a0-e756-4b02-9ab7-35be02df0100 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.750158 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-960e52a0-e756-4b02-9ab7-35be02df0100 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.750626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-960e52a0-e756-4b02-9ab7-35be02df0100 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.751911 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-960e52a0-e756-4b02-9ab7-35be02df0100 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:21.751911 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-960e52a0-e756-4b02-9ab7-35be02df0100 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:21.752287 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-960e52a0-e756-4b02-9ab7-35be02df0100 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:21.898076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-960e52a0-e756-4b02-9ab7-35be02df0100 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:21.906007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-960e52a0-e756-4b02-9ab7-35be02df0100 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1662 microversion: 2.1 time: 0.168597 Aug 08 02:32:21.906541 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 360/736] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:21 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:22.131050 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e1ae9c61-a27d-476e-8c73-180d0fb7b388 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:22.138837 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e1ae9c61-a27d-476e-8c73-180d0fb7b388 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1724 microversion: 2.1 time: 0.563422 Aug 08 02:32:22.139413 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 377/737] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:21 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1724 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:22.926952 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-60c6eb93-b0ff-4125-87df-cdcb590ac766 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:22.927620 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-60c6eb93-b0ff-4125-87df-cdcb590ac766 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:22.933934 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60c6eb93-b0ff-4125-87df-cdcb590ac766 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:22.934446 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60c6eb93-b0ff-4125-87df-cdcb590ac766 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:22.934910 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60c6eb93-b0ff-4125-87df-cdcb590ac766 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:22.935591 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60c6eb93-b0ff-4125-87df-cdcb590ac766 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:22.936042 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60c6eb93-b0ff-4125-87df-cdcb590ac766 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:22.936461 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60c6eb93-b0ff-4125-87df-cdcb590ac766 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:23.061913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-60c6eb93-b0ff-4125-87df-cdcb590ac766 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:23.069660 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-60c6eb93-b0ff-4125-87df-cdcb590ac766 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1662 microversion: 2.1 time: 0.146580 Aug 08 02:32:23.070232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 361/738] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:22 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1662 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:23.159816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-91212096-544d-44a5-9404-c06ffecacfc7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:23.160415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-91212096-544d-44a5-9404-c06ffecacfc7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:23.167411 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-91212096-544d-44a5-9404-c06ffecacfc7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:23.167883 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-91212096-544d-44a5-9404-c06ffecacfc7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:23.168308 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-91212096-544d-44a5-9404-c06ffecacfc7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:23.168982 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-91212096-544d-44a5-9404-c06ffecacfc7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:23.169424 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-91212096-544d-44a5-9404-c06ffecacfc7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:23.169840 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-91212096-544d-44a5-9404-c06ffecacfc7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:23.299815 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-91212096-544d-44a5-9404-c06ffecacfc7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:23.307658 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-91212096-544d-44a5-9404-c06ffecacfc7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1724 microversion: 2.1 time: 0.151588 Aug 08 02:32:23.308215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 378/739] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:23 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:24.090605 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ed9ab7ef-f598-42e3-9746-198dd413a686 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:24.091217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ed9ab7ef-f598-42e3-9746-198dd413a686 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:24.097493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed9ab7ef-f598-42e3-9746-198dd413a686 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:24.097970 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed9ab7ef-f598-42e3-9746-198dd413a686 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:24.098927 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed9ab7ef-f598-42e3-9746-198dd413a686 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:24.099610 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed9ab7ef-f598-42e3-9746-198dd413a686 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:24.100062 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed9ab7ef-f598-42e3-9746-198dd413a686 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:24.100487 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ed9ab7ef-f598-42e3-9746-198dd413a686 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:24.233108 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ed9ab7ef-f598-42e3-9746-198dd413a686 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:24.241107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ed9ab7ef-f598-42e3-9746-198dd413a686 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1662 microversion: 2.1 time: 0.154324 Aug 08 02:32:24.241673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 362/740] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:24 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:24.329338 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9bfba8f7-8434-40c7-afa2-4ac619345122 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:24.329976 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9bfba8f7-8434-40c7-afa2-4ac619345122 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:24.336787 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9bfba8f7-8434-40c7-afa2-4ac619345122 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:24.337256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9bfba8f7-8434-40c7-afa2-4ac619345122 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:24.337678 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9bfba8f7-8434-40c7-afa2-4ac619345122 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:24.338370 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9bfba8f7-8434-40c7-afa2-4ac619345122 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:24.338816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9bfba8f7-8434-40c7-afa2-4ac619345122 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:24.339228 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9bfba8f7-8434-40c7-afa2-4ac619345122 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:24.465922 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-9bfba8f7-8434-40c7-afa2-4ac619345122 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:24.474492 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9bfba8f7-8434-40c7-afa2-4ac619345122 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1724 microversion: 2.1 time: 0.148880 Aug 08 02:32:24.475056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 379/741] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:24 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:25.262096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9b178f08-ddbc-4093-87b4-9ce798455149 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:25.262755 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9b178f08-ddbc-4093-87b4-9ce798455149 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:25.269098 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b178f08-ddbc-4093-87b4-9ce798455149 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:25.269576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b178f08-ddbc-4093-87b4-9ce798455149 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:25.270009 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b178f08-ddbc-4093-87b4-9ce798455149 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:25.270717 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b178f08-ddbc-4093-87b4-9ce798455149 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:25.271176 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b178f08-ddbc-4093-87b4-9ce798455149 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:25.271598 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b178f08-ddbc-4093-87b4-9ce798455149 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:25.404935 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9b178f08-ddbc-4093-87b4-9ce798455149 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:25.412917 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9b178f08-ddbc-4093-87b4-9ce798455149 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1662 microversion: 2.1 time: 0.154623 Aug 08 02:32:25.413485 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 363/742] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:25 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:25.495952 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c5a7c1a7-b75e-42a3-982f-d397d7d56a0f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:25.496554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c5a7c1a7-b75e-42a3-982f-d397d7d56a0f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:25.502970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c5a7c1a7-b75e-42a3-982f-d397d7d56a0f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:25.503444 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c5a7c1a7-b75e-42a3-982f-d397d7d56a0f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:25.503870 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c5a7c1a7-b75e-42a3-982f-d397d7d56a0f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:25.504543 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c5a7c1a7-b75e-42a3-982f-d397d7d56a0f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:25.504985 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c5a7c1a7-b75e-42a3-982f-d397d7d56a0f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:25.505398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c5a7c1a7-b75e-42a3-982f-d397d7d56a0f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:25.630452 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c5a7c1a7-b75e-42a3-982f-d397d7d56a0f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:25.638484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c5a7c1a7-b75e-42a3-982f-d397d7d56a0f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1724 microversion: 2.1 time: 0.146298 Aug 08 02:32:25.639053 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 380/743] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:25 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:26.434454 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e15eb355-0ef1-40ac-8a32-93b8045c7d75 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:26.435066 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e15eb355-0ef1-40ac-8a32-93b8045c7d75 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:26.441747 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e15eb355-0ef1-40ac-8a32-93b8045c7d75 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:26.442753 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e15eb355-0ef1-40ac-8a32-93b8045c7d75 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:26.443191 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e15eb355-0ef1-40ac-8a32-93b8045c7d75 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:26.443872 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e15eb355-0ef1-40ac-8a32-93b8045c7d75 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:26.444323 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e15eb355-0ef1-40ac-8a32-93b8045c7d75 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:26.444741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e15eb355-0ef1-40ac-8a32-93b8045c7d75 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:26.573429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e15eb355-0ef1-40ac-8a32-93b8045c7d75 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:26.580826 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e15eb355-0ef1-40ac-8a32-93b8045c7d75 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1666 microversion: 2.1 time: 0.150609 Aug 08 02:32:26.581386 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 364/744] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:26 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:26.659203 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-75066130-eb12-45b6-8aaf-114b75575f4a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:26.659809 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-75066130-eb12-45b6-8aaf-114b75575f4a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:26.666185 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-75066130-eb12-45b6-8aaf-114b75575f4a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:26.666693 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-75066130-eb12-45b6-8aaf-114b75575f4a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:26.667122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-75066130-eb12-45b6-8aaf-114b75575f4a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:26.667801 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-75066130-eb12-45b6-8aaf-114b75575f4a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:26.668248 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-75066130-eb12-45b6-8aaf-114b75575f4a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:26.668671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-75066130-eb12-45b6-8aaf-114b75575f4a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:26.800554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-75066130-eb12-45b6-8aaf-114b75575f4a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:26.808854 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-75066130-eb12-45b6-8aaf-114b75575f4a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1730 microversion: 2.1 time: 0.153419 Aug 08 02:32:26.809409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 381/745] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:26 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:32:26.830268 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e5b3c8f3-0a8f-4146-be0b-431417dfb00e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:26.830766 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e5b3c8f3-0a8f-4146-be0b-431417dfb00e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:26.836539 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5b3c8f3-0a8f-4146-be0b-431417dfb00e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:26.837011 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5b3c8f3-0a8f-4146-be0b-431417dfb00e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:26.837439 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5b3c8f3-0a8f-4146-be0b-431417dfb00e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:26.838117 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5b3c8f3-0a8f-4146-be0b-431417dfb00e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:26.838588 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5b3c8f3-0a8f-4146-be0b-431417dfb00e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:26.839006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e5b3c8f3-0a8f-4146-be0b-431417dfb00e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:26.917478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e5b3c8f3-0a8f-4146-be0b-431417dfb00e tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090925 Aug 08 02:32:26.918100 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 365/746] 10.222.0.39 () {58 vars in 1275 bytes} [Mon Aug 8 02:32:26 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:27.788958 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-badc53f8-6356-46dd-bf1a-4f2bd9fc790c req-830d87a2-500c-48eb-b5fb-f6c3010fa72b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62da7e2f-df45-473c-bdee-84d29c6ccfcf", "tag": "5d4b749d-627c-40da-b320-bd2ec4551c36"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:27.799812 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-badc53f8-6356-46dd-bf1a-4f2bd9fc790c req-830d87a2-500c-48eb-b5fb-f6c3010fa72b service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:27.800292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-badc53f8-6356-46dd-bf1a-4f2bd9fc790c req-830d87a2-500c-48eb-b5fb-f6c3010fa72b service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:27.800716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-badc53f8-6356-46dd-bf1a-4f2bd9fc790c req-830d87a2-500c-48eb-b5fb-f6c3010fa72b service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:27.811805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-badc53f8-6356-46dd-bf1a-4f2bd9fc790c req-830d87a2-500c-48eb-b5fb-f6c3010fa72b service nova] Creating event network-changed:5d4b749d-627c-40da-b320-bd2ec4551c36 for instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf on hv-cinder-73306 Aug 08 02:32:27.817371 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-badc53f8-6356-46dd-bf1a-4f2bd9fc790c req-830d87a2-500c-48eb-b5fb-f6c3010fa72b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031537 Aug 08 02:32:27.817986 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 382/747] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:32:28.063815 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9f934621-1e0b-46e3-a446-2897056b4eb2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:28.064386 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9f934621-1e0b-46e3-a446-2897056b4eb2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:28.071703 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f934621-1e0b-46e3-a446-2897056b4eb2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:28.072189 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f934621-1e0b-46e3-a446-2897056b4eb2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:28.072768 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f934621-1e0b-46e3-a446-2897056b4eb2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:28.073468 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f934621-1e0b-46e3-a446-2897056b4eb2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:28.073919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f934621-1e0b-46e3-a446-2897056b4eb2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:28.074532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f934621-1e0b-46e3-a446-2897056b4eb2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:28.099146 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9f934621-1e0b-46e3-a446-2897056b4eb2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d/ips" status: 200 len: 150 microversion: 2.1 time: 0.153269 Aug 08 02:32:28.099715 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 366/748] 10.222.0.39 () {58 vars in 1248 bytes} [Mon Aug 8 02:32:27 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d/ips => generated 150 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:28.111486 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8525f4a4-f392-481a-922b-275466bc5125 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ded2a2b5-8201-4fc9-9bda-e11b100f7992"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:28.114431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8525f4a4-f392-481a-922b-275466bc5125 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:28.120591 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8525f4a4-f392-481a-922b-275466bc5125 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:28.121073 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8525f4a4-f392-481a-922b-275466bc5125 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:28.121703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8525f4a4-f392-481a-922b-275466bc5125 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:28.122432 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8525f4a4-f392-481a-922b-275466bc5125 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:28.123120 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8525f4a4-f392-481a-922b-275466bc5125 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:28.123292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8525f4a4-f392-481a-922b-275466bc5125 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:28.212200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-8525f4a4-f392-481a-922b-275466bc5125 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Invalid volume: volume ded2a2b5-8201-4fc9-9bda-e11b100f7992 is already attached to instances: b4568714-ae5a-47eb-9140-be5702dd288e Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8525f4a4-f392-481a-922b-275466bc5125 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: POST /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d/os-volume_attachments HTTP/1.1 Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 74 Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:32:28.213625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:32:28.214965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:32:28.214965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:32:28.214965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:32:28.214965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:32:28.214965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:32:28.214965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:32:28.214965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:32:28.214965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:32:28.214965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:32:28.214965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Aug 08 02:32:28.214965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {"volumeAttachment": {"volumeId": "ded2a2b5-8201-4fc9-9bda-e11b100f7992"}} Aug 08 02:32:28.214965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Invalid volume: volume ded2a2b5-8201-4fc9-9bda-e11b100f7992 is already attached to instances: b4568714-ae5a-47eb-9140-be5702dd288e Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'server_id': '618e3559-1b3a-43a9-aede-202dbd418c4d', 'body': {'volumeAttachment': {'volumeId': 'ded2a2b5-8201-4fc9-9bda-e11b100f7992'}}} Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ded2a2b5-8201-4fc9-9bda-e11b100f7992 is already attached to instances: b4568714-ae5a-47eb-9140-be5702dd288e Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:28.215744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ded2a2b5-8201-4fc9-9bda-e11b100f7992 is already attached to instances: b4568714-ae5a-47eb-9140-be5702dd288e Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:28.216856 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:28.218128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:28.218128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:32:28.218128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:32:28.218128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ded2a2b5-8201-4fc9-9bda-e11b100f7992 is already attached to instances: b4568714-ae5a-47eb-9140-be5702dd288e Aug 08 02:32:28.218128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:28.218128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8525f4a4-f392-481a-922b-275466bc5125 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 400 to user: Invalid volume: volume ded2a2b5-8201-4fc9-9bda-e11b100f7992 is already attached to instances: b4568714-ae5a-47eb-9140-be5702dd288e {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:32:28.218128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8525f4a4-f392-481a-922b-275466bc5125 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108031 Aug 08 02:32:28.218128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 383/749] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:32:28 2022] POST /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:32:28.224103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-074b7bee-902e-42ab-a24c-21df98e1f499 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:28.224599 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-074b7bee-902e-42ab-a24c-21df98e1f499 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:28.230776 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-074b7bee-902e-42ab-a24c-21df98e1f499 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:28.231485 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-074b7bee-902e-42ab-a24c-21df98e1f499 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:28.232146 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-074b7bee-902e-42ab-a24c-21df98e1f499 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:28.233054 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-074b7bee-902e-42ab-a24c-21df98e1f499 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:28.233713 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-074b7bee-902e-42ab-a24c-21df98e1f499 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:28.234365 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-074b7bee-902e-42ab-a24c-21df98e1f499 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:28.260694 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-074b7bee-902e-42ab-a24c-21df98e1f499 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:32:28.313592 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:28.351989 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-074b7bee-902e-42ab-a24c-21df98e1f499 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 204 len: 0 microversion: 2.1 time: 0.130621 Aug 08 02:32:28.352606 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 367/750] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:32:28 2022] DELETE /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:32:28.362981 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f0bf6151-8065-48eb-a1ae-de69209dfe56 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:28.364366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f0bf6151-8065-48eb-a1ae-de69209dfe56 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:28.373035 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f0bf6151-8065-48eb-a1ae-de69209dfe56 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:28.373524 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f0bf6151-8065-48eb-a1ae-de69209dfe56 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:28.373960 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f0bf6151-8065-48eb-a1ae-de69209dfe56 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:28.374710 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f0bf6151-8065-48eb-a1ae-de69209dfe56 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:28.375164 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f0bf6151-8065-48eb-a1ae-de69209dfe56 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:28.375586 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f0bf6151-8065-48eb-a1ae-de69209dfe56 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:28.391712 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:28.520055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f0bf6151-8065-48eb-a1ae-de69209dfe56 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:28.528105 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f0bf6151-8065-48eb-a1ae-de69209dfe56 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1683 microversion: 2.1 time: 0.170095 Aug 08 02:32:28.528773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 384/751] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:28 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:29.549399 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-344bd88c-3180-4a43-b82a-249579077cbb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:29.550094 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-344bd88c-3180-4a43-b82a-249579077cbb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:29.556974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-344bd88c-3180-4a43-b82a-249579077cbb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:29.557449 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-344bd88c-3180-4a43-b82a-249579077cbb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:29.557876 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-344bd88c-3180-4a43-b82a-249579077cbb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:29.558584 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-344bd88c-3180-4a43-b82a-249579077cbb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:29.559032 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-344bd88c-3180-4a43-b82a-249579077cbb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:29.559450 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-344bd88c-3180-4a43-b82a-249579077cbb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:29.689183 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-344bd88c-3180-4a43-b82a-249579077cbb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:29.697613 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-344bd88c-3180-4a43-b82a-249579077cbb tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1683 microversion: 2.1 time: 0.152386 Aug 08 02:32:29.698176 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 368/752] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:29 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:29.831401 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-75022992-9488-4d0a-886b-76f4833f249d req-76d1e5b7-df73-4847-841b-841a2b4bd256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62da7e2f-df45-473c-bdee-84d29c6ccfcf", "tag": "5d4b749d-627c-40da-b320-bd2ec4551c36"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:29.840878 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-75022992-9488-4d0a-886b-76f4833f249d req-76d1e5b7-df73-4847-841b-841a2b4bd256 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:29.841340 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-75022992-9488-4d0a-886b-76f4833f249d req-76d1e5b7-df73-4847-841b-841a2b4bd256 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:29.841756 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-75022992-9488-4d0a-886b-76f4833f249d req-76d1e5b7-df73-4847-841b-841a2b4bd256 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:29.852667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-75022992-9488-4d0a-886b-76f4833f249d req-76d1e5b7-df73-4847-841b-841a2b4bd256 service nova] Creating event network-changed:5d4b749d-627c-40da-b320-bd2ec4551c36 for instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf on hv-cinder-73306 Aug 08 02:32:29.857403 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-75022992-9488-4d0a-886b-76f4833f249d req-76d1e5b7-df73-4847-841b-841a2b4bd256 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029635 Aug 08 02:32:29.858057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 385/753] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:30.031179 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:32:30.031414 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Mon Aug 8 02:32:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:32:30.718158 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7954a878-4936-4893-9db1-fbf196df1639 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:30.718789 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7954a878-4936-4893-9db1-fbf196df1639 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:30.725230 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7954a878-4936-4893-9db1-fbf196df1639 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:30.725706 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7954a878-4936-4893-9db1-fbf196df1639 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:30.726133 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7954a878-4936-4893-9db1-fbf196df1639 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:30.726853 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7954a878-4936-4893-9db1-fbf196df1639 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:30.727299 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7954a878-4936-4893-9db1-fbf196df1639 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:30.727722 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7954a878-4936-4893-9db1-fbf196df1639 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:30.859265 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7954a878-4936-4893-9db1-fbf196df1639 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:30.866910 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7954a878-4936-4893-9db1-fbf196df1639 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1683 microversion: 2.1 time: 0.152549 Aug 08 02:32:30.867681 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 369/754] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:30 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:31.691963 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-f41cf6ad-293c-45e0-93e9-03d3dd8ec258 req-9a1fbb23-ba95-4396-959a-e83c272c890a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618e3559-1b3a-43a9-aede-202dbd418c4d", "name": "network-vif-deleted", "tag": "4c1d8531-ad0b-4d95-b972-a3fde8050eea"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:31.703409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-f41cf6ad-293c-45e0-93e9-03d3dd8ec258 req-9a1fbb23-ba95-4396-959a-e83c272c890a service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:31.704234 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-f41cf6ad-293c-45e0-93e9-03d3dd8ec258 req-9a1fbb23-ba95-4396-959a-e83c272c890a service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:31.704981 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-f41cf6ad-293c-45e0-93e9-03d3dd8ec258 req-9a1fbb23-ba95-4396-959a-e83c272c890a service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:31.717245 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-f41cf6ad-293c-45e0-93e9-03d3dd8ec258 req-9a1fbb23-ba95-4396-959a-e83c272c890a service nova] Creating event network-vif-deleted:4c1d8531-ad0b-4d95-b972-a3fde8050eea for instance 618e3559-1b3a-43a9-aede-202dbd418c4d on hv-cinder-73306 Aug 08 02:32:31.722209 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-f41cf6ad-293c-45e0-93e9-03d3dd8ec258 req-9a1fbb23-ba95-4396-959a-e83c272c890a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035352 Aug 08 02:32:31.723984 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 386/755] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:31.888331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:31.889264 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:31.892113 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:31.899159 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:31.899674 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:31.900277 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:31.900976 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:31.901587 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:31.902000 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:31.935798 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:31.936553 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:31.937008 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:31.937602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lazy-loading 'fault' on Instance uuid 618e3559-1b3a-43a9-aede-202dbd418c4d {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:32:31.980402 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:31.987945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1e93f3c2-d72c-4c33-b5de-3074c3dda9ea tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 200 len: 1332 microversion: 2.1 time: 0.103423 Aug 08 02:32:31.988400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 370/756] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:31 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:33.010023 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-91bd1c6d-6952-4684-a4e9-0293e41062aa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:33.010729 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-91bd1c6d-6952-4684-a4e9-0293e41062aa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:33.017049 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-91bd1c6d-6952-4684-a4e9-0293e41062aa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:33.017537 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-91bd1c6d-6952-4684-a4e9-0293e41062aa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:33.017972 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-91bd1c6d-6952-4684-a4e9-0293e41062aa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:33.018701 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-91bd1c6d-6952-4684-a4e9-0293e41062aa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:33.019150 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-91bd1c6d-6952-4684-a4e9-0293e41062aa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:33.019569 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-91bd1c6d-6952-4684-a4e9-0293e41062aa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:33.033518 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-91bd1c6d-6952-4684-a4e9-0293e41062aa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-91bd1c6d-6952-4684-a4e9-0293e41062aa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d HTTP/1.1 Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:32:33.035187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:32:33.037264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:32:33.037264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:32:33.037264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:32:33.037264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:32:33.037264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:32:33.037264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:32:33.037264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:32:33.037264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:32:33.037264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:32:33.037264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:32:33.037264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:32:33.037264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '618e3559-1b3a-43a9-aede-202dbd418c4d'} Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:32:33.038865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:32:33.040772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:32:33.042096 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-91bd1c6d-6952-4684-a4e9-0293e41062aa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 404 to user: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:32:33.042096 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-91bd1c6d-6952-4684-a4e9-0293e41062aa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 404 len: 111 microversion: 2.1 time: 0.031812 Aug 08 02:32:33.042096 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 387/757] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:33 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:32:33.045918 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ec1d821d-80de-4180-8877-65dd1e14d11f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '.version_select at 0x7f32958c2dc0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:33.070422 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ec1d821d-80de-4180-8877-65dd1e14d11f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035145644" status: 202 len: 0 microversion: 2.1 time: 0.028181 Aug 08 02:32:33.071020 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 371/758] 10.222.0.39 () {58 vars in 1221 bytes} [Mon Aug 8 02:32:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035145644 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:32:33.746273 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a6de7c67-d200-409b-bf96-193c592280c3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:33.746779 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a6de7c67-d200-409b-bf96-193c592280c3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:33.752911 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a6de7c67-d200-409b-bf96-193c592280c3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:33.753392 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a6de7c67-d200-409b-bf96-193c592280c3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:33.753824 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a6de7c67-d200-409b-bf96-193c592280c3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:33.755068 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a6de7c67-d200-409b-bf96-193c592280c3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:33.755517 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a6de7c67-d200-409b-bf96-193c592280c3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:33.755937 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a6de7c67-d200-409b-bf96-193c592280c3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:33.835415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.objects.instance [None req-a6de7c67-d200-409b-bf96-193c592280c3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lazy-loading 'services' on Instance uuid b4568714-ae5a-47eb-9140-be5702dd288e {{(pid=117640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:32:33.946306 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a6de7c67-d200-409b-bf96-193c592280c3 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/os-volume_attachments/ded2a2b5-8201-4fc9-9bda-e11b100f7992" status: 202 len: 0 microversion: 2.1 time: 0.203910 Aug 08 02:32:33.946952 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 388/759] 10.222.0.39 () {58 vars in 1416 bytes} [Mon Aug 8 02:32:33 2022] DELETE /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/os-volume_attachments/ded2a2b5-8201-4fc9-9bda-e11b100f7992 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:32:33.955859 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0fd137d8-7cff-4753-a6c2-19f51bcbaca5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:33.958637 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0fd137d8-7cff-4753-a6c2-19f51bcbaca5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:33.965866 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0fd137d8-7cff-4753-a6c2-19f51bcbaca5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:33.966964 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0fd137d8-7cff-4753-a6c2-19f51bcbaca5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:33.967406 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0fd137d8-7cff-4753-a6c2-19f51bcbaca5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:33.968269 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0fd137d8-7cff-4753-a6c2-19f51bcbaca5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:33.968723 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0fd137d8-7cff-4753-a6c2-19f51bcbaca5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:33.969140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0fd137d8-7cff-4753-a6c2-19f51bcbaca5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:33.999513 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0fd137d8-7cff-4753-a6c2-19f51bcbaca5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047694 Aug 08 02:32:34.000088 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 372/760] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:32:33 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:35.012870 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4d3def5f-a285-45a3-ae97-bdcad2be5755 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:35.015207 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4d3def5f-a285-45a3-ae97-bdcad2be5755 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:35.022020 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d3def5f-a285-45a3-ae97-bdcad2be5755 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:35.022591 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d3def5f-a285-45a3-ae97-bdcad2be5755 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:35.023031 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d3def5f-a285-45a3-ae97-bdcad2be5755 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:35.023716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d3def5f-a285-45a3-ae97-bdcad2be5755 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:35.024164 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d3def5f-a285-45a3-ae97-bdcad2be5755 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:35.024584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d3def5f-a285-45a3-ae97-bdcad2be5755 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:35.054444 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4d3def5f-a285-45a3-ae97-bdcad2be5755 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046422 Aug 08 02:32:35.054988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 389/761] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:32:35 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:36.067036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0facd883-da33-4bc1-82b9-78d972ca0f12 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:36.069922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0facd883-da33-4bc1-82b9-78d972ca0f12 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:36.076439 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0facd883-da33-4bc1-82b9-78d972ca0f12 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:36.076923 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0facd883-da33-4bc1-82b9-78d972ca0f12 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:36.077366 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0facd883-da33-4bc1-82b9-78d972ca0f12 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:36.078052 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0facd883-da33-4bc1-82b9-78d972ca0f12 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:36.078528 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0facd883-da33-4bc1-82b9-78d972ca0f12 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:36.078981 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0facd883-da33-4bc1-82b9-78d972ca0f12 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:36.109910 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0facd883-da33-4bc1-82b9-78d972ca0f12 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047318 Aug 08 02:32:36.110502 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 373/762] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:32:36 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:32:36.171686 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a450f499-07e1-4719-8a00-8fb8bf94c511 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:36.172174 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a450f499-07e1-4719-8a00-8fb8bf94c511 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:36.179303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a450f499-07e1-4719-8a00-8fb8bf94c511 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:36.179786 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a450f499-07e1-4719-8a00-8fb8bf94c511 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:36.180214 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a450f499-07e1-4719-8a00-8fb8bf94c511 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:36.180882 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a450f499-07e1-4719-8a00-8fb8bf94c511 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:36.181322 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a450f499-07e1-4719-8a00-8fb8bf94c511 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:36.181736 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a450f499-07e1-4719-8a00-8fb8bf94c511 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:36.206644 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a450f499-07e1-4719-8a00-8fb8bf94c511 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:32:36.280885 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a450f499-07e1-4719-8a00-8fb8bf94c511 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 204 len: 0 microversion: 2.1 time: 0.112719 Aug 08 02:32:36.281723 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 390/763] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:32:36 2022] DELETE /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:32:36.290461 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-367a972a-e26e-4b12-93dc-deb1c92add09 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:36.291102 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-367a972a-e26e-4b12-93dc-deb1c92add09 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:36.297832 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-367a972a-e26e-4b12-93dc-deb1c92add09 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:36.298338 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-367a972a-e26e-4b12-93dc-deb1c92add09 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:36.298767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-367a972a-e26e-4b12-93dc-deb1c92add09 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:36.299446 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-367a972a-e26e-4b12-93dc-deb1c92add09 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:36.299889 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-367a972a-e26e-4b12-93dc-deb1c92add09 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:36.300302 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-367a972a-e26e-4b12-93dc-deb1c92add09 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:36.444226 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-367a972a-e26e-4b12-93dc-deb1c92add09 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:36.453637 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-367a972a-e26e-4b12-93dc-deb1c92add09 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1681 microversion: 2.1 time: 0.167728 Aug 08 02:32:36.454206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 374/764] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:36 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:37.477932 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2d0311ae-524d-4a35-a6aa-09c0659421d1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:37.478674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2d0311ae-524d-4a35-a6aa-09c0659421d1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:37.484712 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2d0311ae-524d-4a35-a6aa-09c0659421d1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:37.485183 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2d0311ae-524d-4a35-a6aa-09c0659421d1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:37.485611 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2d0311ae-524d-4a35-a6aa-09c0659421d1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:37.486307 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2d0311ae-524d-4a35-a6aa-09c0659421d1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:37.486755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2d0311ae-524d-4a35-a6aa-09c0659421d1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:37.487179 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2d0311ae-524d-4a35-a6aa-09c0659421d1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:37.615727 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2d0311ae-524d-4a35-a6aa-09c0659421d1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:37.623131 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2d0311ae-524d-4a35-a6aa-09c0659421d1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1681 microversion: 2.1 time: 0.149359 Aug 08 02:32:37.623691 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 391/765] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:37 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:38.465645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-371037c7-e791-4a1e-8baa-466753381726 req-21ff0a7c-4902-42ff-a2e0-27342a9dfbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4568714-ae5a-47eb-9140-be5702dd288e", "name": "network-vif-deleted", "tag": "64cd5cbd-515d-4839-a3a7-ee52df20970a"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:38.476921 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-371037c7-e791-4a1e-8baa-466753381726 req-21ff0a7c-4902-42ff-a2e0-27342a9dfbc9 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:38.477663 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-371037c7-e791-4a1e-8baa-466753381726 req-21ff0a7c-4902-42ff-a2e0-27342a9dfbc9 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:38.478205 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-371037c7-e791-4a1e-8baa-466753381726 req-21ff0a7c-4902-42ff-a2e0-27342a9dfbc9 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:38.489910 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-371037c7-e791-4a1e-8baa-466753381726 req-21ff0a7c-4902-42ff-a2e0-27342a9dfbc9 service nova] Creating event network-vif-deleted:64cd5cbd-515d-4839-a3a7-ee52df20970a for instance b4568714-ae5a-47eb-9140-be5702dd288e on hv-cinder-73306 Aug 08 02:32:38.495392 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-371037c7-e791-4a1e-8baa-466753381726 req-21ff0a7c-4902-42ff-a2e0-27342a9dfbc9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033272 Aug 08 02:32:38.496294 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 375/766] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:38.643054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:38.643675 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:38.651017 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:38.651706 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:38.652142 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:38.652935 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:38.653393 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:38.653836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:38.694580 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:38.695279 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:38.695813 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:38.696329 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.objects.instance [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lazy-loading 'fault' on Instance uuid b4568714-ae5a-47eb-9140-be5702dd288e {{(pid=117640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:32:38.737612 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:38.746415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1cc773b2-14c1-47f1-9692-792095941f76 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 200 len: 1331 microversion: 2.1 time: 0.106449 Aug 08 02:32:38.746415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 392/767] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:38 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:39.767355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cc8a8fd1-8f29-4b1c-880f-524ab9a49865 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:39.768061 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cc8a8fd1-8f29-4b1c-880f-524ab9a49865 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:39.774841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc8a8fd1-8f29-4b1c-880f-524ab9a49865 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:39.775323 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc8a8fd1-8f29-4b1c-880f-524ab9a49865 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:39.775760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc8a8fd1-8f29-4b1c-880f-524ab9a49865 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:39.776450 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc8a8fd1-8f29-4b1c-880f-524ab9a49865 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:39.776911 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc8a8fd1-8f29-4b1c-880f-524ab9a49865 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:39.777336 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc8a8fd1-8f29-4b1c-880f-524ab9a49865 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:39.790284 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-cc8a8fd1-8f29-4b1c-880f-524ab9a49865 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cc8a8fd1-8f29-4b1c-880f-524ab9a49865 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e HTTP/1.1 Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:32:39.791860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:32:39.793411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:32:39.793411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:32:39.793411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:32:39.793411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:32:39.793411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:32:39.793411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:32:39.793411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:32:39.793411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:32:39.793411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:32:39.793411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:32:39.793411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:32:39.793411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': 'b4568714-ae5a-47eb-9140-be5702dd288e'} Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:32:39.794333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:32:39.796076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:32:39.797432 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cc8a8fd1-8f29-4b1c-880f-524ab9a49865 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 404 to user: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:32:39.797432 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cc8a8fd1-8f29-4b1c-880f-524ab9a49865 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 404 len: 111 microversion: 2.1 time: 0.030706 Aug 08 02:32:39.797432 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 376/768] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:39 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:32:39.801905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-18193daf-06b8-40db-92b0-0ecd56c5a461 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '.version_select at 0x7f32951690d0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:39.821685 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-18193daf-06b8-40db-92b0-0ecd56c5a461 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385408535" status: 202 len: 0 microversion: 2.1 time: 0.023457 Aug 08 02:32:39.822228 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 393/769] 10.222.0.39 () {58 vars in 1221 bytes} [Mon Aug 8 02:32:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385408535 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:32:40.452198 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5985215d-8726-4228-8082-85422e3847fa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: .version_select at 0x7f329588d3a0>, body: {"keypair": {"name": "tempest-keypair-564635980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5qPKtl+z1RJSpkc7RRCfY8T9uiDenJgPliutBXdZ0r1Hc5GeShz4OKUTplejIW8k84atkx6XD0t/xHbA/4ijiYgGYgNfmxYf8XHefFRBaRfR9MqgAlMFoK4wc2cB9rIA=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:40.468862 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-5985215d-8726-4228-8082-85422e3847fa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:32:40.473243 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-5985215d-8726-4228-8082-85422e3847fa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for user 43dd72b161f8442285dea411741d66b3 and project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:32:40.495243 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5985215d-8726-4228-8082-85422e3847fa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046869 Aug 08 02:32:40.495839 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 377/770] 10.222.0.39 () {60 vars in 1159 bytes} [Mon Aug 8 02:32:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:41.704815 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-201155246", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a62e92c-7187-4f0e-842d-c113cd8a0af1"}], "security_groups": [{"name": "tempest-securitygroup--302433246"}], "key_name": "tempest-keypair-564635980", "user_data": "}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:41.810340 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.network.neutron [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] validate_networks() for [('2a62e92c-7187-4f0e-842d-c113cd8a0af1', None, None, None, None, None)] {{(pid=117640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:32:42.260779 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Flavor limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:32:42.261197 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Image limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:32:42.261664 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Flavor pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:32:42.262066 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Image pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:32:42.262505 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:32:42.271828 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:42.272303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:42.272737 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:42.273456 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:42.273919 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:42.274355 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:42.291672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:32:42.295637 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for user 43dd72b161f8442285dea411741d66b3 and project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:32:42.306380 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Going to run 1 instances... {{(pid=117640) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:32:42.308607 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:32:42.355807 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0d3a1f5b-74d7-4a7f-b95d-58760de3549a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.655737 Aug 08 02:32:42.356434 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 394/771] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:32:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:32:42.368160 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-44c33788-7224-4d49-891f-a76ee15024c1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:42.368845 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-44c33788-7224-4d49-891f-a76ee15024c1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:42.428185 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-44c33788-7224-4d49-891f-a76ee15024c1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:42.436178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-44c33788-7224-4d49-891f-a76ee15024c1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1240 microversion: 2.1 time: 0.072693 Aug 08 02:32:42.436765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 378/772] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:42 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:43.458054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2051fbc0-7640-4dec-a625-d00ff83a8b7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:43.458722 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2051fbc0-7640-4dec-a625-d00ff83a8b7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:43.460709 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:43.466345 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2051fbc0-7640-4dec-a625-d00ff83a8b7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:43.466827 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2051fbc0-7640-4dec-a625-d00ff83a8b7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:43.467259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2051fbc0-7640-4dec-a625-d00ff83a8b7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:43.467955 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2051fbc0-7640-4dec-a625-d00ff83a8b7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:43.468516 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2051fbc0-7640-4dec-a625-d00ff83a8b7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:43.469070 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2051fbc0-7640-4dec-a625-d00ff83a8b7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:43.559183 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2051fbc0-7640-4dec-a625-d00ff83a8b7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:43.568077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2051fbc0-7640-4dec-a625-d00ff83a8b7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1300 microversion: 2.1 time: 0.114974 Aug 08 02:32:43.568649 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 395/773] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:43 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:44.589182 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2505126c-e36a-437d-9076-60d406750f69 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:44.589758 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2505126c-e36a-437d-9076-60d406750f69 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:44.595615 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2505126c-e36a-437d-9076-60d406750f69 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:44.596264 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2505126c-e36a-437d-9076-60d406750f69 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:44.596692 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2505126c-e36a-437d-9076-60d406750f69 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:44.597380 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2505126c-e36a-437d-9076-60d406750f69 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:44.597827 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2505126c-e36a-437d-9076-60d406750f69 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:44.598265 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2505126c-e36a-437d-9076-60d406750f69 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:44.727919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2505126c-e36a-437d-9076-60d406750f69 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:44.735711 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2505126c-e36a-437d-9076-60d406750f69 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1365 microversion: 2.1 time: 0.150659 Aug 08 02:32:44.736366 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 379/774] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:44 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:44.955645 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-75e4360a-f8e3-431d-b878-02fac1040337 req-20da8234-a20d-44d3-89fe-0f1adf5ad3ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68078741-87cd-4d1a-a760-fbc0dd0f29ef", "tag": "fc502db4-9fb3-4112-bb84-be191e4232e5"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:44.966420 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-75e4360a-f8e3-431d-b878-02fac1040337 req-20da8234-a20d-44d3-89fe-0f1adf5ad3ea service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:44.967141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-75e4360a-f8e3-431d-b878-02fac1040337 req-20da8234-a20d-44d3-89fe-0f1adf5ad3ea service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:44.967825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-75e4360a-f8e3-431d-b878-02fac1040337 req-20da8234-a20d-44d3-89fe-0f1adf5ad3ea service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:44.985957 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-75e4360a-f8e3-431d-b878-02fac1040337 req-20da8234-a20d-44d3-89fe-0f1adf5ad3ea service nova] Creating event network-changed:fc502db4-9fb3-4112-bb84-be191e4232e5 for instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef on hv-cinder-73306 Aug 08 02:32:44.990652 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-75e4360a-f8e3-431d-b878-02fac1040337 req-20da8234-a20d-44d3-89fe-0f1adf5ad3ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038977 Aug 08 02:32:44.991223 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 396/775] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:45.757087 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7c6b8ca9-af9d-4b3d-8ec6-aeb65ac079ca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:45.757707 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7c6b8ca9-af9d-4b3d-8ec6-aeb65ac079ca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:45.764107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c6b8ca9-af9d-4b3d-8ec6-aeb65ac079ca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:45.764582 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c6b8ca9-af9d-4b3d-8ec6-aeb65ac079ca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:45.765014 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c6b8ca9-af9d-4b3d-8ec6-aeb65ac079ca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:45.765695 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c6b8ca9-af9d-4b3d-8ec6-aeb65ac079ca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:45.766144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c6b8ca9-af9d-4b3d-8ec6-aeb65ac079ca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:45.766600 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c6b8ca9-af9d-4b3d-8ec6-aeb65ac079ca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:45.895673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7c6b8ca9-af9d-4b3d-8ec6-aeb65ac079ca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:45.903068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7c6b8ca9-af9d-4b3d-8ec6-aeb65ac079ca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1365 microversion: 2.1 time: 0.150354 Aug 08 02:32:45.903671 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 380/776] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:45 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:46.924468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2f453a39-8f08-4dee-bf73-9fcbe8a4b225 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:46.925171 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2f453a39-8f08-4dee-bf73-9fcbe8a4b225 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:46.931320 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f453a39-8f08-4dee-bf73-9fcbe8a4b225 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:46.931798 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f453a39-8f08-4dee-bf73-9fcbe8a4b225 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:46.932228 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f453a39-8f08-4dee-bf73-9fcbe8a4b225 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:46.932915 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f453a39-8f08-4dee-bf73-9fcbe8a4b225 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:46.933363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f453a39-8f08-4dee-bf73-9fcbe8a4b225 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:46.933780 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2f453a39-8f08-4dee-bf73-9fcbe8a4b225 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:47.064239 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2f453a39-8f08-4dee-bf73-9fcbe8a4b225 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:47.071910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2f453a39-8f08-4dee-bf73-9fcbe8a4b225 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1365 microversion: 2.1 time: 0.152229 Aug 08 02:32:47.072467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 397/777] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:46 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:48.092266 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8c0ce502-ab1c-47f7-a172-6999fcade6ab tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:48.092878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8c0ce502-ab1c-47f7-a172-6999fcade6ab tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:48.099165 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c0ce502-ab1c-47f7-a172-6999fcade6ab tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:48.099640 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c0ce502-ab1c-47f7-a172-6999fcade6ab tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:48.100069 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c0ce502-ab1c-47f7-a172-6999fcade6ab tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:48.100751 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c0ce502-ab1c-47f7-a172-6999fcade6ab tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:48.101200 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c0ce502-ab1c-47f7-a172-6999fcade6ab tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:48.101613 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c0ce502-ab1c-47f7-a172-6999fcade6ab tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:48.229228 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8c0ce502-ab1c-47f7-a172-6999fcade6ab tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:48.236865 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8c0ce502-ab1c-47f7-a172-6999fcade6ab tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1365 microversion: 2.1 time: 0.148468 Aug 08 02:32:48.237441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 381/778] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:48 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:49.257171 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0eb604b1-f5ac-4a41-9a6c-15e68ba3b7fc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:49.257782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0eb604b1-f5ac-4a41-9a6c-15e68ba3b7fc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:49.264189 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0eb604b1-f5ac-4a41-9a6c-15e68ba3b7fc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:49.264667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0eb604b1-f5ac-4a41-9a6c-15e68ba3b7fc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:49.265125 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0eb604b1-f5ac-4a41-9a6c-15e68ba3b7fc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:49.265805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0eb604b1-f5ac-4a41-9a6c-15e68ba3b7fc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:49.266271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0eb604b1-f5ac-4a41-9a6c-15e68ba3b7fc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:49.266691 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0eb604b1-f5ac-4a41-9a6c-15e68ba3b7fc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:49.395896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0eb604b1-f5ac-4a41-9a6c-15e68ba3b7fc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:49.403266 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0eb604b1-f5ac-4a41-9a6c-15e68ba3b7fc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1365 microversion: 2.1 time: 0.149934 Aug 08 02:32:49.403823 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 398/779] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:49 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:50.424270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-692c0903-e089-4101-b641-2b425a050927 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:50.424882 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-692c0903-e089-4101-b641-2b425a050927 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:50.432091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-692c0903-e089-4101-b641-2b425a050927 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:50.432571 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-692c0903-e089-4101-b641-2b425a050927 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:50.433008 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-692c0903-e089-4101-b641-2b425a050927 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:50.433700 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-692c0903-e089-4101-b641-2b425a050927 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:50.434154 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-692c0903-e089-4101-b641-2b425a050927 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:50.434603 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-692c0903-e089-4101-b641-2b425a050927 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:50.560878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-692c0903-e089-4101-b641-2b425a050927 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:50.568560 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-692c0903-e089-4101-b641-2b425a050927 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1365 microversion: 2.1 time: 0.148154 Aug 08 02:32:50.569127 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 382/780] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:50 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:51.588933 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e7981894-d236-4069-8076-f16293016251 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:51.589541 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e7981894-d236-4069-8076-f16293016251 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:51.595955 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7981894-d236-4069-8076-f16293016251 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:51.596458 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7981894-d236-4069-8076-f16293016251 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:51.596887 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7981894-d236-4069-8076-f16293016251 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:51.597567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7981894-d236-4069-8076-f16293016251 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:51.598012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7981894-d236-4069-8076-f16293016251 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:51.598468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7981894-d236-4069-8076-f16293016251 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:51.725097 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e7981894-d236-4069-8076-f16293016251 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:51.732431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e7981894-d236-4069-8076-f16293016251 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1365 microversion: 2.1 time: 0.147460 Aug 08 02:32:51.732988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 399/781] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:51 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:52.254486 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-c48de4cb-aaf8-45c7-83e9-c1e151a26466 req-427bbfc0-2653-4212-b214-b4293010f05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68078741-87cd-4d1a-a760-fbc0dd0f29ef", "name": "network-vif-plugged", "status": "completed", "tag": "fc502db4-9fb3-4112-bb84-be191e4232e5"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:52.264770 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-c48de4cb-aaf8-45c7-83e9-c1e151a26466 req-427bbfc0-2653-4212-b214-b4293010f05c service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:52.265184 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-c48de4cb-aaf8-45c7-83e9-c1e151a26466 req-427bbfc0-2653-4212-b214-b4293010f05c service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:52.265613 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-c48de4cb-aaf8-45c7-83e9-c1e151a26466 req-427bbfc0-2653-4212-b214-b4293010f05c service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:52.277333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-c48de4cb-aaf8-45c7-83e9-c1e151a26466 req-427bbfc0-2653-4212-b214-b4293010f05c service nova] Creating event network-vif-plugged:fc502db4-9fb3-4112-bb84-be191e4232e5 for instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef on hv-cinder-73306 Aug 08 02:32:52.282765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-c48de4cb-aaf8-45c7-83e9-c1e151a26466 req-427bbfc0-2653-4212-b214-b4293010f05c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032054 Aug 08 02:32:52.283523 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 383/782] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:52.755261 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-48c04a75-387a-49ee-97a4-0abe0d287668 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:52.755872 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-48c04a75-387a-49ee-97a4-0abe0d287668 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:52.757838 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:52.758554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=6 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:52.764645 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-48c04a75-387a-49ee-97a4-0abe0d287668 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:52.765128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-48c04a75-387a-49ee-97a4-0abe0d287668 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:52.765562 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-48c04a75-387a-49ee-97a4-0abe0d287668 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:52.766276 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-48c04a75-387a-49ee-97a4-0abe0d287668 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:52.766721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-48c04a75-387a-49ee-97a4-0abe0d287668 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:52.767150 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-48c04a75-387a-49ee-97a4-0abe0d287668 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:52.893709 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-48c04a75-387a-49ee-97a4-0abe0d287668 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:52.901120 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-48c04a75-387a-49ee-97a4-0abe0d287668 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1365 microversion: 2.1 time: 0.150343 Aug 08 02:32:52.901690 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 400/783] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:52 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:53.919060 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:53.924149 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-65a8fa28-5930-4694-a214-371f631ee109 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:53.924841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-65a8fa28-5930-4694-a214-371f631ee109 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:53.931167 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65a8fa28-5930-4694-a214-371f631ee109 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:53.931641 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65a8fa28-5930-4694-a214-371f631ee109 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:53.932068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65a8fa28-5930-4694-a214-371f631ee109 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:53.932769 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65a8fa28-5930-4694-a214-371f631ee109 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:53.933213 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65a8fa28-5930-4694-a214-371f631ee109 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:53.933631 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65a8fa28-5930-4694-a214-371f631ee109 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:54.063806 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-65a8fa28-5930-4694-a214-371f631ee109 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:54.071804 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-65a8fa28-5930-4694-a214-371f631ee109 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1365 microversion: 2.1 time: 0.153747 Aug 08 02:32:54.072361 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 384/784] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:53 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:55.093091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5989204c-32e0-4c30-bb24-a1837f100295 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:55.093685 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5989204c-32e0-4c30-bb24-a1837f100295 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:55.100897 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5989204c-32e0-4c30-bb24-a1837f100295 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.101380 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5989204c-32e0-4c30-bb24-a1837f100295 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.101817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5989204c-32e0-4c30-bb24-a1837f100295 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.102526 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5989204c-32e0-4c30-bb24-a1837f100295 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.102981 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5989204c-32e0-4c30-bb24-a1837f100295 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.103414 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5989204c-32e0-4c30-bb24-a1837f100295 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.234648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5989204c-32e0-4c30-bb24-a1837f100295 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:55.242010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5989204c-32e0-4c30-bb24-a1837f100295 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1555 microversion: 2.1 time: 0.152886 Aug 08 02:32:55.242631 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 401/785] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:55 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:55.261615 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-333c319d-210d-44e7-a7f5-1802577b0047 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:55.262104 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-333c319d-210d-44e7-a7f5-1802577b0047 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:55.268417 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-333c319d-210d-44e7-a7f5-1802577b0047 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.268886 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-333c319d-210d-44e7-a7f5-1802577b0047 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.269838 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-333c319d-210d-44e7-a7f5-1802577b0047 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.270539 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-333c319d-210d-44e7-a7f5-1802577b0047 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.270986 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-333c319d-210d-44e7-a7f5-1802577b0047 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.271400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-333c319d-210d-44e7-a7f5-1802577b0047 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.346457 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-333c319d-210d-44e7-a7f5-1802577b0047 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088556 Aug 08 02:32:55.347055 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 385/786] 10.222.0.39 () {58 vars in 1275 bytes} [Mon Aug 8 02:32:55 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:55.584332 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5263c128-6bf2-4dbc-84dc-b87aab08a6b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:55.586616 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5263c128-6bf2-4dbc-84dc-b87aab08a6b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:55.592357 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5263c128-6bf2-4dbc-84dc-b87aab08a6b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.592831 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5263c128-6bf2-4dbc-84dc-b87aab08a6b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.593253 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5263c128-6bf2-4dbc-84dc-b87aab08a6b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.593931 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5263c128-6bf2-4dbc-84dc-b87aab08a6b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.594403 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5263c128-6bf2-4dbc-84dc-b87aab08a6b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.594874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5263c128-6bf2-4dbc-84dc-b87aab08a6b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.626410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:55.670659 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5263c128-6bf2-4dbc-84dc-b87aab08a6b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "POST /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/action" status: 202 len: 0 microversion: 2.1 time: 0.090601 Aug 08 02:32:55.674658 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 402/787] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:32:55 2022] POST /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:32:55.679821 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-41bcde92-2bf2-4eac-99c7-0784b0a28b27 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:55.680530 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-41bcde92-2bf2-4eac-99c7-0784b0a28b27 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:55.687374 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41bcde92-2bf2-4eac-99c7-0784b0a28b27 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.688041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41bcde92-2bf2-4eac-99c7-0784b0a28b27 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.688665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41bcde92-2bf2-4eac-99c7-0784b0a28b27 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:55.689617 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41bcde92-2bf2-4eac-99c7-0784b0a28b27 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:55.690546 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41bcde92-2bf2-4eac-99c7-0784b0a28b27 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:55.691761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41bcde92-2bf2-4eac-99c7-0784b0a28b27 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:56.131091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-41bcde92-2bf2-4eac-99c7-0784b0a28b27 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:56.139645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-41bcde92-2bf2-4eac-99c7-0784b0a28b27 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1750 microversion: 2.1 time: 0.463740 Aug 08 02:32:56.140236 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 386/788] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:55 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1750 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:56.643686 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-0870fd96-a285-44cb-b8c0-8e38b79440a9 req-939e8b31-1070-4bb4-a19d-d627b513c341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68078741-87cd-4d1a-a760-fbc0dd0f29ef", "tag": "fc502db4-9fb3-4112-bb84-be191e4232e5"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:32:56.653746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-0870fd96-a285-44cb-b8c0-8e38b79440a9 req-939e8b31-1070-4bb4-a19d-d627b513c341 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:56.654136 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-0870fd96-a285-44cb-b8c0-8e38b79440a9 req-939e8b31-1070-4bb4-a19d-d627b513c341 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:56.654589 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-0870fd96-a285-44cb-b8c0-8e38b79440a9 req-939e8b31-1070-4bb4-a19d-d627b513c341 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:56.666429 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-0870fd96-a285-44cb-b8c0-8e38b79440a9 req-939e8b31-1070-4bb4-a19d-d627b513c341 service nova] Creating event network-changed:fc502db4-9fb3-4112-bb84-be191e4232e5 for instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef on hv-cinder-73306 Aug 08 02:32:56.671240 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-0870fd96-a285-44cb-b8c0-8e38b79440a9 req-939e8b31-1070-4bb4-a19d-d627b513c341 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032013 Aug 08 02:32:56.671840 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 403/789] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:32:57.160512 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-03901da6-ee90-45e9-8306-fcf961feddbf tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:57.161131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-03901da6-ee90-45e9-8306-fcf961feddbf tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:57.168707 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03901da6-ee90-45e9-8306-fcf961feddbf tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:57.169201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03901da6-ee90-45e9-8306-fcf961feddbf tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:57.169635 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03901da6-ee90-45e9-8306-fcf961feddbf tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:57.170550 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03901da6-ee90-45e9-8306-fcf961feddbf tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:57.171005 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03901da6-ee90-45e9-8306-fcf961feddbf tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:57.171586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03901da6-ee90-45e9-8306-fcf961feddbf tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:57.325869 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-03901da6-ee90-45e9-8306-fcf961feddbf tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:57.334176 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-03901da6-ee90-45e9-8306-fcf961feddbf tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1755 microversion: 2.1 time: 0.177584 Aug 08 02:32:57.335106 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 387/790] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:57 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:58.356365 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8338e722-7ead-42d4-a904-06cbad55da2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:58.357091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8338e722-7ead-42d4-a904-06cbad55da2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:58.363310 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8338e722-7ead-42d4-a904-06cbad55da2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:58.363787 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8338e722-7ead-42d4-a904-06cbad55da2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:58.364222 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8338e722-7ead-42d4-a904-06cbad55da2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:58.364898 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8338e722-7ead-42d4-a904-06cbad55da2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:58.365346 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8338e722-7ead-42d4-a904-06cbad55da2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:58.365764 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8338e722-7ead-42d4-a904-06cbad55da2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:58.507853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8338e722-7ead-42d4-a904-06cbad55da2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:58.515779 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8338e722-7ead-42d4-a904-06cbad55da2e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1755 microversion: 2.1 time: 0.164064 Aug 08 02:32:58.516340 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 404/791] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:58 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:32:59.537881 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-494f083c-4619-4704-9f70-14e4db1e845d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:32:59.538520 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-494f083c-4619-4704-9f70-14e4db1e845d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:32:59.544923 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494f083c-4619-4704-9f70-14e4db1e845d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:59.545408 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494f083c-4619-4704-9f70-14e4db1e845d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:59.545841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494f083c-4619-4704-9f70-14e4db1e845d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:59.546636 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494f083c-4619-4704-9f70-14e4db1e845d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:32:59.547091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494f083c-4619-4704-9f70-14e4db1e845d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:32:59.547518 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494f083c-4619-4704-9f70-14e4db1e845d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:32:59.551382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:32:59.689510 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-494f083c-4619-4704-9f70-14e4db1e845d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:32:59.697879 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-494f083c-4619-4704-9f70-14e4db1e845d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1755 microversion: 2.1 time: 0.164479 Aug 08 02:32:59.698493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 388/792] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:32:59 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:00.719643 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-536072d2-74ac-4ea2-9cc1-f4c81a7a2185 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:00.720198 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-536072d2-74ac-4ea2-9cc1-f4c81a7a2185 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:00.727071 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-536072d2-74ac-4ea2-9cc1-f4c81a7a2185 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:00.727546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-536072d2-74ac-4ea2-9cc1-f4c81a7a2185 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:00.727985 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-536072d2-74ac-4ea2-9cc1-f4c81a7a2185 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:00.728637 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-536072d2-74ac-4ea2-9cc1-f4c81a7a2185 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:00.729078 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-536072d2-74ac-4ea2-9cc1-f4c81a7a2185 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:00.729489 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-536072d2-74ac-4ea2-9cc1-f4c81a7a2185 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:00.876128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-536072d2-74ac-4ea2-9cc1-f4c81a7a2185 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:00.884062 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-536072d2-74ac-4ea2-9cc1-f4c81a7a2185 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1755 microversion: 2.1 time: 0.168315 Aug 08 02:33:00.884626 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 405/793] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:00 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:01.904431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8292892b-cd06-498d-b124-b546b38ac6ca tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:01.905048 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8292892b-cd06-498d-b124-b546b38ac6ca tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:01.907368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:01.912547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8292892b-cd06-498d-b124-b546b38ac6ca tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:01.913027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8292892b-cd06-498d-b124-b546b38ac6ca tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:01.913458 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8292892b-cd06-498d-b124-b546b38ac6ca tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:01.914144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8292892b-cd06-498d-b124-b546b38ac6ca tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:01.914627 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8292892b-cd06-498d-b124-b546b38ac6ca tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:01.915047 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8292892b-cd06-498d-b124-b546b38ac6ca tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:02.060151 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8292892b-cd06-498d-b124-b546b38ac6ca tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:02.068905 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8292892b-cd06-498d-b124-b546b38ac6ca tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1755 microversion: 2.1 time: 0.168311 Aug 08 02:33:02.069475 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 389/794] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:01 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:03.089535 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3a8a0060-ff4e-4a77-899c-ad9fb801c386 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:03.090710 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3a8a0060-ff4e-4a77-899c-ad9fb801c386 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:03.099945 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3a8a0060-ff4e-4a77-899c-ad9fb801c386 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:03.100416 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3a8a0060-ff4e-4a77-899c-ad9fb801c386 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:03.100841 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3a8a0060-ff4e-4a77-899c-ad9fb801c386 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:03.101515 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3a8a0060-ff4e-4a77-899c-ad9fb801c386 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:03.101958 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3a8a0060-ff4e-4a77-899c-ad9fb801c386 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:03.102399 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3a8a0060-ff4e-4a77-899c-ad9fb801c386 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:03.241306 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3a8a0060-ff4e-4a77-899c-ad9fb801c386 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:03.249174 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3a8a0060-ff4e-4a77-899c-ad9fb801c386 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1755 microversion: 2.1 time: 0.164371 Aug 08 02:33:03.249737 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 406/795] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:03 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:04.270852 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c507d3ec-c280-401c-bfd0-5dab6f03548f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:04.271500 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c507d3ec-c280-401c-bfd0-5dab6f03548f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:04.277993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c507d3ec-c280-401c-bfd0-5dab6f03548f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:04.278498 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c507d3ec-c280-401c-bfd0-5dab6f03548f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:04.278931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c507d3ec-c280-401c-bfd0-5dab6f03548f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:04.279615 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c507d3ec-c280-401c-bfd0-5dab6f03548f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:04.280063 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c507d3ec-c280-401c-bfd0-5dab6f03548f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:04.280484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c507d3ec-c280-401c-bfd0-5dab6f03548f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:04.419551 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c507d3ec-c280-401c-bfd0-5dab6f03548f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:04.427570 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c507d3ec-c280-401c-bfd0-5dab6f03548f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1755 microversion: 2.1 time: 0.161149 Aug 08 02:33:04.428165 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 390/796] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:04 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:05.448967 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5abe9921-9f22-45f8-8ec3-8cd5e1f792b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:05.449567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5abe9921-9f22-45f8-8ec3-8cd5e1f792b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:05.455988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5abe9921-9f22-45f8-8ec3-8cd5e1f792b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:05.456477 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5abe9921-9f22-45f8-8ec3-8cd5e1f792b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:05.456901 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5abe9921-9f22-45f8-8ec3-8cd5e1f792b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:05.457581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5abe9921-9f22-45f8-8ec3-8cd5e1f792b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:05.458021 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5abe9921-9f22-45f8-8ec3-8cd5e1f792b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:05.459092 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5abe9921-9f22-45f8-8ec3-8cd5e1f792b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:05.598170 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5abe9921-9f22-45f8-8ec3-8cd5e1f792b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:05.606038 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5abe9921-9f22-45f8-8ec3-8cd5e1f792b4 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1755 microversion: 2.1 time: 0.160998 Aug 08 02:33:05.606634 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 407/797] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:05 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:06.627408 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-967d8c7b-83e6-4881-8d2e-a015a55dc8b0 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:06.628014 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-967d8c7b-83e6-4881-8d2e-a015a55dc8b0 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:06.634356 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-967d8c7b-83e6-4881-8d2e-a015a55dc8b0 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:06.634834 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-967d8c7b-83e6-4881-8d2e-a015a55dc8b0 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:06.635266 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-967d8c7b-83e6-4881-8d2e-a015a55dc8b0 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:06.635944 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-967d8c7b-83e6-4881-8d2e-a015a55dc8b0 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:06.636393 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-967d8c7b-83e6-4881-8d2e-a015a55dc8b0 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:06.636815 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-967d8c7b-83e6-4881-8d2e-a015a55dc8b0 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:06.779822 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-967d8c7b-83e6-4881-8d2e-a015a55dc8b0 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:06.787680 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-967d8c7b-83e6-4881-8d2e-a015a55dc8b0 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1755 microversion: 2.1 time: 0.164108 Aug 08 02:33:06.788249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 391/798] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:06 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:07.808643 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-44cd56e0-0eff-4825-8e1b-7769d4feb63f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:07.809288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-44cd56e0-0eff-4825-8e1b-7769d4feb63f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:07.815875 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-44cd56e0-0eff-4825-8e1b-7769d4feb63f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:07.816361 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-44cd56e0-0eff-4825-8e1b-7769d4feb63f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:07.816799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-44cd56e0-0eff-4825-8e1b-7769d4feb63f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:07.817504 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-44cd56e0-0eff-4825-8e1b-7769d4feb63f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:07.817960 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-44cd56e0-0eff-4825-8e1b-7769d4feb63f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:07.818414 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-44cd56e0-0eff-4825-8e1b-7769d4feb63f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:07.962821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-44cd56e0-0eff-4825-8e1b-7769d4feb63f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:07.970637 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-44cd56e0-0eff-4825-8e1b-7769d4feb63f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1755 microversion: 2.1 time: 0.165954 Aug 08 02:33:07.971200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 408/799] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:07 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:08.992698 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-39428aff-61ee-4f78-bfeb-4e6a1d351241 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:08.993310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-39428aff-61ee-4f78-bfeb-4e6a1d351241 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:08.999712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39428aff-61ee-4f78-bfeb-4e6a1d351241 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:09.000185 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39428aff-61ee-4f78-bfeb-4e6a1d351241 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:09.000616 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39428aff-61ee-4f78-bfeb-4e6a1d351241 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:09.001298 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39428aff-61ee-4f78-bfeb-4e6a1d351241 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:09.001747 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39428aff-61ee-4f78-bfeb-4e6a1d351241 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:09.002168 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-39428aff-61ee-4f78-bfeb-4e6a1d351241 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:09.144092 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-39428aff-61ee-4f78-bfeb-4e6a1d351241 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:09.152137 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-39428aff-61ee-4f78-bfeb-4e6a1d351241 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1758 microversion: 2.1 time: 0.163292 Aug 08 02:33:09.152708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 392/800] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:08 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:33.757866 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1fae3d75-b40d-4083-946f-eedb68ca8a1f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:33.760126 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1fae3d75-b40d-4083-946f-eedb68ca8a1f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:33.762685 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=27 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:33.763338 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:33.769291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1fae3d75-b40d-4083-946f-eedb68ca8a1f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:33.769764 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1fae3d75-b40d-4083-946f-eedb68ca8a1f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:33.770195 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1fae3d75-b40d-4083-946f-eedb68ca8a1f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:33.770895 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1fae3d75-b40d-4083-946f-eedb68ca8a1f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:33.771341 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1fae3d75-b40d-4083-946f-eedb68ca8a1f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:33.771757 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1fae3d75-b40d-4083-946f-eedb68ca8a1f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:33.803890 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1fae3d75-b40d-4083-946f-eedb68ca8a1f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049907 Aug 08 02:33:33.804431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 409/801] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:33:33 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:33:33.864670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b0d28514-9574-49f8-9c73-5ef57a88184c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:33.865154 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b0d28514-9574-49f8-9c73-5ef57a88184c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:33.867348 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=7 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:33.868156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=29 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:33.873478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0d28514-9574-49f8-9c73-5ef57a88184c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:33.873952 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0d28514-9574-49f8-9c73-5ef57a88184c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:33.874421 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0d28514-9574-49f8-9c73-5ef57a88184c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:33.875106 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0d28514-9574-49f8-9c73-5ef57a88184c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:33.875560 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0d28514-9574-49f8-9c73-5ef57a88184c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:33.875985 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b0d28514-9574-49f8-9c73-5ef57a88184c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:33.899778 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b0d28514-9574-49f8-9c73-5ef57a88184c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:33:33.972617 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b0d28514-9574-49f8-9c73-5ef57a88184c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 204 len: 0 microversion: 2.1 time: 0.111489 Aug 08 02:33:33.973122 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 393/802] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:33:33 2022] DELETE /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:33:33.982032 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-482bf7e6-b502-4323-bb15-6d12078be505 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:33.982666 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-482bf7e6-b502-4323-bb15-6d12078be505 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:33.989353 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-482bf7e6-b502-4323-bb15-6d12078be505 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:33.989904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-482bf7e6-b502-4323-bb15-6d12078be505 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:33.990358 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-482bf7e6-b502-4323-bb15-6d12078be505 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:33.991043 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-482bf7e6-b502-4323-bb15-6d12078be505 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:33.991485 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-482bf7e6-b502-4323-bb15-6d12078be505 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:33.991898 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-482bf7e6-b502-4323-bb15-6d12078be505 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:34.118671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-482bf7e6-b502-4323-bb15-6d12078be505 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:34.126032 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-482bf7e6-b502-4323-bb15-6d12078be505 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1672 microversion: 2.1 time: 0.148478 Aug 08 02:33:34.126629 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 410/803] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:33 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:34.264782 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4abcdf71-9c88-4dcb-81b6-4683974f2ee7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:34.265357 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4abcdf71-9c88-4dcb-81b6-4683974f2ee7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:34.271682 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4abcdf71-9c88-4dcb-81b6-4683974f2ee7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:34.272158 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4abcdf71-9c88-4dcb-81b6-4683974f2ee7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:34.272583 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4abcdf71-9c88-4dcb-81b6-4683974f2ee7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:34.273276 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4abcdf71-9c88-4dcb-81b6-4683974f2ee7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:34.273722 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4abcdf71-9c88-4dcb-81b6-4683974f2ee7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:34.274139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4abcdf71-9c88-4dcb-81b6-4683974f2ee7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:34.351564 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-4abcdf71-9c88-4dcb-81b6-4683974f2ee7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lazy-loading 'services' on Instance uuid 62da7e2f-df45-473c-bdee-84d29c6ccfcf {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:33:34.420504 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4abcdf71-9c88-4dcb-81b6-4683974f2ee7 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "DELETE /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments/65295624-76f4-4767-ac3f-9b9eb1728076" status: 202 len: 0 microversion: 2.1 time: 0.159677 Aug 08 02:33:34.421096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 394/804] 10.222.0.39 () {58 vars in 1416 bytes} [Mon Aug 8 02:33:34 2022] DELETE /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments/65295624-76f4-4767-ac3f-9b9eb1728076 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:33:34.435420 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ec28dac0-2494-449e-a977-f33d5e7a80db tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:34.437628 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ec28dac0-2494-449e-a977-f33d5e7a80db tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:34.444420 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec28dac0-2494-449e-a977-f33d5e7a80db tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:34.444896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec28dac0-2494-449e-a977-f33d5e7a80db tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:34.445351 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec28dac0-2494-449e-a977-f33d5e7a80db tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:34.446050 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec28dac0-2494-449e-a977-f33d5e7a80db tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:34.446498 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec28dac0-2494-449e-a977-f33d5e7a80db tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:34.446916 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec28dac0-2494-449e-a977-f33d5e7a80db tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:34.475656 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ec28dac0-2494-449e-a977-f33d5e7a80db tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050271 Aug 08 02:33:34.476207 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 411/805] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:33:34 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:33:35.147493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a9c1ff79-dac6-49bd-b914-460b67329007 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:35.148156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a9c1ff79-dac6-49bd-b914-460b67329007 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:35.154690 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9c1ff79-dac6-49bd-b914-460b67329007 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:35.155167 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9c1ff79-dac6-49bd-b914-460b67329007 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:35.155607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9c1ff79-dac6-49bd-b914-460b67329007 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:35.156290 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9c1ff79-dac6-49bd-b914-460b67329007 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:35.156763 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9c1ff79-dac6-49bd-b914-460b67329007 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:35.157182 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9c1ff79-dac6-49bd-b914-460b67329007 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:35.288641 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a9c1ff79-dac6-49bd-b914-460b67329007 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:35.296050 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a9c1ff79-dac6-49bd-b914-460b67329007 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1672 microversion: 2.1 time: 0.152862 Aug 08 02:33:35.296614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 395/806] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:35 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:35.488535 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-601657fb-12b2-43c1-a668-4d9c2e5d3a4f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:35.490809 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-601657fb-12b2-43c1-a668-4d9c2e5d3a4f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:35.497210 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-601657fb-12b2-43c1-a668-4d9c2e5d3a4f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:35.497692 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-601657fb-12b2-43c1-a668-4d9c2e5d3a4f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:35.498125 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-601657fb-12b2-43c1-a668-4d9c2e5d3a4f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:35.498847 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-601657fb-12b2-43c1-a668-4d9c2e5d3a4f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:35.499298 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-601657fb-12b2-43c1-a668-4d9c2e5d3a4f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:35.499722 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-601657fb-12b2-43c1-a668-4d9c2e5d3a4f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:35.528539 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-601657fb-12b2-43c1-a668-4d9c2e5d3a4f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044561 Aug 08 02:33:35.529130 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 412/807] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:33:35 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:33:36.318026 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4c08d934-2500-4313-b0be-c4f169b3f002 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:36.319776 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4c08d934-2500-4313-b0be-c4f169b3f002 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:36.326030 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c08d934-2500-4313-b0be-c4f169b3f002 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.326818 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c08d934-2500-4313-b0be-c4f169b3f002 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.327476 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c08d934-2500-4313-b0be-c4f169b3f002 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.328449 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c08d934-2500-4313-b0be-c4f169b3f002 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.330075 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c08d934-2500-4313-b0be-c4f169b3f002 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.330611 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c08d934-2500-4313-b0be-c4f169b3f002 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.403645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4c08d934-2500-4313-b0be-c4f169b3f002 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:36.411469 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4c08d934-2500-4313-b0be-c4f169b3f002 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1605 microversion: 2.1 time: 0.098430 Aug 08 02:33:36.417044 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 396/808] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:36 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1605 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:36.540016 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-864e3604-01b8-4962-8462-bdcd95dca30c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:36.542266 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-864e3604-01b8-4962-8462-bdcd95dca30c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:36.549640 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-864e3604-01b8-4962-8462-bdcd95dca30c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.550684 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-864e3604-01b8-4962-8462-bdcd95dca30c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.551128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-864e3604-01b8-4962-8462-bdcd95dca30c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.551837 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-864e3604-01b8-4962-8462-bdcd95dca30c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.552290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-864e3604-01b8-4962-8462-bdcd95dca30c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.552749 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-864e3604-01b8-4962-8462-bdcd95dca30c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.589138 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-864e3604-01b8-4962-8462-bdcd95dca30c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053076 Aug 08 02:33:36.590669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 413/809] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:33:36 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:33:36.602977 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-628bfc82-5b9b-436a-9c24-02a2abe6e6f4 req-852b8659-ab62-449c-aca7-58d39820b2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a61fcac-cea3-4e95-a463-bb2f44b28e39", "name": "network-vif-deleted", "tag": "f05f2dd7-1c3e-44dc-8f0b-bf42643bdea5"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:36.613532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-628bfc82-5b9b-436a-9c24-02a2abe6e6f4 req-852b8659-ab62-449c-aca7-58d39820b2df service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.613947 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-628bfc82-5b9b-436a-9c24-02a2abe6e6f4 req-852b8659-ab62-449c-aca7-58d39820b2df service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.614401 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-628bfc82-5b9b-436a-9c24-02a2abe6e6f4 req-852b8659-ab62-449c-aca7-58d39820b2df service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.627600 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-628bfc82-5b9b-436a-9c24-02a2abe6e6f4 req-852b8659-ab62-449c-aca7-58d39820b2df service nova] Creating event network-vif-deleted:f05f2dd7-1c3e-44dc-8f0b-bf42643bdea5 for instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 on hv-cinder-73306 Aug 08 02:33:36.633542 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-628bfc82-5b9b-436a-9c24-02a2abe6e6f4 req-852b8659-ab62-449c-aca7-58d39820b2df service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 Aug 08 02:33:36.634335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 397/810] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:33:36.669948 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-24480190-17c9-4d93-b158-149358207542 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:36.670582 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-24480190-17c9-4d93-b158-149358207542 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:36.686781 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-24480190-17c9-4d93-b158-149358207542 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.687280 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-24480190-17c9-4d93-b158-149358207542 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.687915 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-24480190-17c9-4d93-b158-149358207542 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.688784 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-24480190-17c9-4d93-b158-149358207542 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.689470 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-24480190-17c9-4d93-b158-149358207542 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.690517 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-24480190-17c9-4d93-b158-149358207542 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.719512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-24480190-17c9-4d93-b158-149358207542 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:33:36.811308 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-24480190-17c9-4d93-b158-149358207542 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "DELETE /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 204 len: 0 microversion: 2.1 time: 0.145319 Aug 08 02:33:36.815401 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 414/811] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:33:36 2022] DELETE /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:33:36.821269 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-15ab7ac1-4c80-4de1-97f5-7fcd96686d5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:36.822143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-15ab7ac1-4c80-4de1-97f5-7fcd96686d5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:36.830916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15ab7ac1-4c80-4de1-97f5-7fcd96686d5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.831741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15ab7ac1-4c80-4de1-97f5-7fcd96686d5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.832462 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15ab7ac1-4c80-4de1-97f5-7fcd96686d5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.833592 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15ab7ac1-4c80-4de1-97f5-7fcd96686d5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:36.834381 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15ab7ac1-4c80-4de1-97f5-7fcd96686d5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:36.835035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15ab7ac1-4c80-4de1-97f5-7fcd96686d5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:36.985624 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-15ab7ac1-4c80-4de1-97f5-7fcd96686d5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:36.994377 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-15ab7ac1-4c80-4de1-97f5-7fcd96686d5d tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1690 microversion: 2.1 time: 0.177302 Aug 08 02:33:36.994975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 398/812] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:36 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:37.433732 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:37.434631 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:37.444944 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:37.444944 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:37.444944 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:37.444944 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:37.445372 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:37.445372 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:37.478401 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:37.478890 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:37.479326 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:37.479770 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.objects.instance [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lazy-loading 'fault' on Instance uuid 2a61fcac-cea3-4e95-a463-bb2f44b28e39 {{(pid=117640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:33:37.524799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:37.533048 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a887d9d6-189a-4aee-946d-33e8d0d2996a tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1327 microversion: 2.1 time: 0.103618 Aug 08 02:33:37.533541 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 415/813] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:37 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:38.015535 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a00323a5-6649-4744-a81f-bd23c2e4d486 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:38.016170 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a00323a5-6649-4744-a81f-bd23c2e4d486 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:38.022972 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a00323a5-6649-4744-a81f-bd23c2e4d486 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:38.023449 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a00323a5-6649-4744-a81f-bd23c2e4d486 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:38.023873 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a00323a5-6649-4744-a81f-bd23c2e4d486 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:38.024547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a00323a5-6649-4744-a81f-bd23c2e4d486 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:38.024994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a00323a5-6649-4744-a81f-bd23c2e4d486 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:38.025407 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a00323a5-6649-4744-a81f-bd23c2e4d486 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:38.151490 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a00323a5-6649-4744-a81f-bd23c2e4d486 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:38.160981 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a00323a5-6649-4744-a81f-bd23c2e4d486 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1690 microversion: 2.1 time: 0.148924 Aug 08 02:33:38.161978 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 399/814] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:38 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:38.555103 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:38.555716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:38.562179 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:38.562693 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:38.563129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:38.563813 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:38.564267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:38.564693 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:38.595321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:38.595790 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:38.596213 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:38.596643 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.objects.instance [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lazy-loading 'fault' on Instance uuid 2a61fcac-cea3-4e95-a463-bb2f44b28e39 {{(pid=117640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:33:38.636519 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:38.643871 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-55865a8e-3b1e-472e-b70b-e2926d16ee45 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1327 microversion: 2.1 time: 0.092575 Aug 08 02:33:38.644433 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 416/815] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:38 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1327 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:39.184500 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-42c2cfe0-ef3b-46b3-91c0-154765fb0474 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:39.185110 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-42c2cfe0-ef3b-46b3-91c0-154765fb0474 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:39.191697 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42c2cfe0-ef3b-46b3-91c0-154765fb0474 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:39.192172 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42c2cfe0-ef3b-46b3-91c0-154765fb0474 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:39.192597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42c2cfe0-ef3b-46b3-91c0-154765fb0474 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:39.193273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42c2cfe0-ef3b-46b3-91c0-154765fb0474 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:39.193714 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42c2cfe0-ef3b-46b3-91c0-154765fb0474 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:39.194128 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42c2cfe0-ef3b-46b3-91c0-154765fb0474 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:39.324889 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-42c2cfe0-ef3b-46b3-91c0-154765fb0474 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:39.332893 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-42c2cfe0-ef3b-46b3-91c0-154765fb0474 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1690 microversion: 2.1 time: 0.152223 Aug 08 02:33:39.333655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 400/816] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:39 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:39.664128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:39.664743 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:39.671028 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:39.671503 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:39.671928 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:39.672600 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:39.673041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:39.673455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:39.705643 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:39.706035 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:39.707116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:39.707548 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.objects.instance [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lazy-loading 'fault' on Instance uuid 2a61fcac-cea3-4e95-a463-bb2f44b28e39 {{(pid=117640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:33:39.752080 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:39.760568 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-026fee4d-4c8b-44b4-af7f-43a189f52fcf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 200 len: 1327 microversion: 2.1 time: 0.100342 Aug 08 02:33:39.761129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 417/817] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:39 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:40.353290 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2a16b3b8-72e8-4e7e-8ced-01e74e81c7fd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:40.353905 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2a16b3b8-72e8-4e7e-8ced-01e74e81c7fd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:40.361180 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a16b3b8-72e8-4e7e-8ced-01e74e81c7fd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:40.361998 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a16b3b8-72e8-4e7e-8ced-01e74e81c7fd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:40.363126 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a16b3b8-72e8-4e7e-8ced-01e74e81c7fd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:40.363841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a16b3b8-72e8-4e7e-8ced-01e74e81c7fd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:40.364294 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a16b3b8-72e8-4e7e-8ced-01e74e81c7fd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:40.364716 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2a16b3b8-72e8-4e7e-8ced-01e74e81c7fd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:40.427951 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2a16b3b8-72e8-4e7e-8ced-01e74e81c7fd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:40.435463 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2a16b3b8-72e8-4e7e-8ced-01e74e81c7fd tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 200 len: 1622 microversion: 2.1 time: 0.086108 Aug 08 02:33:40.436028 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 401/818] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:40 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 1622 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:40.575717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-0ed53ba9-604a-4c8a-aaf0-08a2d71f6ec5 req-d010c12a-33c0-4538-bbd6-1a3fed7966b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62da7e2f-df45-473c-bdee-84d29c6ccfcf", "name": "network-vif-deleted", "tag": "5d4b749d-627c-40da-b320-bd2ec4551c36"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:40.592839 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-0ed53ba9-604a-4c8a-aaf0-08a2d71f6ec5 req-d010c12a-33c0-4538-bbd6-1a3fed7966b0 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:40.593315 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-0ed53ba9-604a-4c8a-aaf0-08a2d71f6ec5 req-d010c12a-33c0-4538-bbd6-1a3fed7966b0 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:40.593746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-0ed53ba9-604a-4c8a-aaf0-08a2d71f6ec5 req-d010c12a-33c0-4538-bbd6-1a3fed7966b0 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:40.608484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-0ed53ba9-604a-4c8a-aaf0-08a2d71f6ec5 req-d010c12a-33c0-4538-bbd6-1a3fed7966b0 service nova] Creating event network-vif-deleted:5d4b749d-627c-40da-b320-bd2ec4551c36 for instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf on hv-cinder-73306 Aug 08 02:33:40.615458 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-0ed53ba9-604a-4c8a-aaf0-08a2d71f6ec5 req-d010c12a-33c0-4538-bbd6-1a3fed7966b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043869 Aug 08 02:33:40.616261 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 418/819] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:33:40.783403 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7bf3779e-86d9-4c5c-8f36-81c8e8fd9586 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:40.784083 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7bf3779e-86d9-4c5c-8f36-81c8e8fd9586 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:40.791119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bf3779e-86d9-4c5c-8f36-81c8e8fd9586 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:40.791944 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bf3779e-86d9-4c5c-8f36-81c8e8fd9586 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:40.792387 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bf3779e-86d9-4c5c-8f36-81c8e8fd9586 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:40.793095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bf3779e-86d9-4c5c-8f36-81c8e8fd9586 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:40.793585 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bf3779e-86d9-4c5c-8f36-81c8e8fd9586 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:40.794120 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bf3779e-86d9-4c5c-8f36-81c8e8fd9586 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:40.807908 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-7bf3779e-86d9-4c5c-8f36-81c8e8fd9586 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] HTTP exception thrown: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7bf3779e-86d9-4c5c-8f36-81c8e8fd9586 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Request method failure captured: Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 HTTP/1.1 Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQg6mzkESqN9A5oZoJ_yeaR8QfkHsuvn7Gnn2Of1q2nwdQWnQJsPQf7qgT1Axr81h4HAPGOPgqHfOOvS3gMsBaNHu9AkrckqNK2QaYCwUHVJESFMZ0zfM2kScAxe3rDA_c-SQ_zKz8JbK3skckXwUZSe3rHR_eIsjUX7TcWIxReByQ Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 9ae7098cc9f24d9dbc4695789c5b87b4 Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:33:40.809543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:33:40.810987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ae7098cc9f24d9dbc4695789c5b87b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ae7098cc9f24d9dbc4695789c5b87b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ae7098cc9f24d9dbc4695789c5b87b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ae7098cc9f24d9dbc4695789c5b87b4"}]}] Aug 08 02:33:40.810987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:33:40.810987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 9ae7098cc9f24d9dbc4695789c5b87b4 Aug 08 02:33:40.810987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:33:40.810987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeTestJSON-603930406-project Aug 08 02:33:40.810987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:33:40.810987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:33:40.810987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 17286ff2e1764ec7b91e6274c7162437 Aug 08 02:33:40.810987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeTestJSON-603930406-project Aug 08 02:33:40.810987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:33:40.810987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:33:40.810987 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '2a61fcac-cea3-4e95-a463-bb2f44b28e39'} Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:33:40.811861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:33:40.813150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:40.814319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7bf3779e-86d9-4c5c-8f36-81c8e8fd9586 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Returning 404 to user: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:33:40.814319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7bf3779e-86d9-4c5c-8f36-81c8e8fd9586 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 404 len: 111 microversion: 2.1 time: 0.032445 Aug 08 02:33:40.814319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 402/820] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:40 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:33:40.820855 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-259898f3-7df9-4822-9a9f-d320ef61d96b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '.version_select at 0x7f32950f21f0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:40.842302 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-259898f3-7df9-4822-9a9f-d320ef61d96b tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725379006" status: 202 len: 0 microversion: 2.1 time: 0.025404 Aug 08 02:33:40.842899 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 419/821] 10.222.0.39 () {58 vars in 1221 bytes} [Mon Aug 8 02:33:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725379006 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:33:41.458109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-111a6aaa-e5c8-4c7b-ada1-542d5821374c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:41.458827 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-111a6aaa-e5c8-4c7b-ada1-542d5821374c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 62da7e2f-df45-473c-bdee-84d29c6ccfcf] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:41.465469 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-111a6aaa-e5c8-4c7b-ada1-542d5821374c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:41.466239 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-111a6aaa-e5c8-4c7b-ada1-542d5821374c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:41.466782 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-111a6aaa-e5c8-4c7b-ada1-542d5821374c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:41.467467 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-111a6aaa-e5c8-4c7b-ada1-542d5821374c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:41.468184 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-111a6aaa-e5c8-4c7b-ada1-542d5821374c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:41.468394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-111a6aaa-e5c8-4c7b-ada1-542d5821374c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:41.486206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-111a6aaa-e5c8-4c7b-ada1-542d5821374c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] HTTP exception thrown: Instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf could not be found. Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-111a6aaa-e5c8-4c7b-ada1-542d5821374c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Request method failure captured: Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf HTTP/1.1 Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQj7nZ596tyWWWEdcaGznu-Z4Br4Pom5I2-PAdLAUN_l4GI5DRgq5KfI9Fl4w_rhUMWFPKnZ3O16ZNtof9AdmY2rGF26JlAQcLDANOgMx4S2l8JMiyb147J-pdIPWo7r6B24FrJ8_yahhcB2zBycszIcITthdplKZyyjWZU9pJnJXE Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 12bf9f0d74de4a57918b688a6d969b28 Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:33:41.488760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:33:41.490053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12bf9f0d74de4a57918b688a6d969b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12bf9f0d74de4a57918b688a6d969b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12bf9f0d74de4a57918b688a6d969b28", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12bf9f0d74de4a57918b688a6d969b28"}]}] Aug 08 02:33:41.490053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:33:41.490053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 12bf9f0d74de4a57918b688a6d969b28 Aug 08 02:33:41.490053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:33:41.490053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-ServerRescueNegativeTestJSON-561377719-project Aug 08 02:33:41.490053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:33:41.490053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:33:41.490053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 1fd1b40cbd884915bdfac150f9718e32 Aug 08 02:33:41.490053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-561377719-project Aug 08 02:33:41.490053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:33:41.490053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf could not be found. Aug 08 02:33:41.490053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '62da7e2f-df45-473c-bdee-84d29c6ccfcf'} Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf could not be found. Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:33:41.490904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf could not be found. Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf could not be found. Aug 08 02:33:41.492041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:41.493119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-111a6aaa-e5c8-4c7b-ada1-542d5821374c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Returning 404 to user: Instance 62da7e2f-df45-473c-bdee-84d29c6ccfcf could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:33:41.493119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-111a6aaa-e5c8-4c7b-ada1-542d5821374c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf" status: 404 len: 111 microversion: 2.1 time: 0.036845 Aug 08 02:33:41.493119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 403/822] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:41 2022] GET /compute/v2.1/servers/62da7e2f-df45-473c-bdee-84d29c6ccfcf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:33:41.500739 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0641f340-6ece-4d27-b51d-d01a5b24d258 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '.version_select at 0x7f32951e80d0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:41.524674 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0641f340-6ece-4d27-b51d-d01a5b24d258 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-377395412" status: 202 len: 0 microversion: 2.1 time: 0.027234 Aug 08 02:33:41.526012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f8bddeaa-c6d0-47a6-b011-b65840220cb8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Action: 'create', calling method: .version_select at 0x7f3295941160>, body: {"keypair": {"name": "tempest-keypair-981984283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTA/riQj4kivclDCsXMX5m/mvVcrAz03CJul289E/j+bQ8wHSdLXPrU9X5lDgW3ojx+atJFyiNSQXapf9OqDucGjbPprwIt28eesvG3PhkFRiPhpyeODm4e1mNOztIwAw=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:41.526517 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 420/823] 10.222.0.39 () {58 vars in 1218 bytes} [Mon Aug 8 02:33:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-377395412 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:33:41.542579 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-f8bddeaa-c6d0-47a6-b011-b65840220cb8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Getting quotas for project 9ae7098cc9f24d9dbc4695789c5b87b4. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:33:41.550789 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-f8bddeaa-c6d0-47a6-b011-b65840220cb8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Getting quotas for user 17286ff2e1764ec7b91e6274c7162437 and project 9ae7098cc9f24d9dbc4695789c5b87b4. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:33:41.577886 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f8bddeaa-c6d0-47a6-b011-b65840220cb8 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056318 Aug 08 02:33:41.584446 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 404/824] 10.222.0.39 () {60 vars in 1159 bytes} [Mon Aug 8 02:33:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:33:42.976228 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1594697355", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fc76955-f5da-4c01-89b2-1843ac68f2ac"}], "security_groups": [{"name": "tempest-securitygroup--387050198"}], "key_name": "tempest-keypair-981984283", "user_data": "}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:43.079506 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.network.neutron [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] validate_networks() for [('3fc76955-f5da-4c01-89b2-1843ac68f2ac', None, None, None, None, None)] {{(pid=117640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:33:43.455458 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Flavor limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:33:43.455881 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Image limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:33:43.456351 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Flavor pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:33:43.456756 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Image pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:33:43.457165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:33:43.466090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:43.466567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:43.466995 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:43.467724 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:43.468180 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:43.468607 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:43.485948 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Getting quotas for project 9ae7098cc9f24d9dbc4695789c5b87b4. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:33:43.490654 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Getting quotas for user 17286ff2e1764ec7b91e6274c7162437 and project 9ae7098cc9f24d9dbc4695789c5b87b4. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:33:43.502086 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Going to run 1 instances... {{(pid=117640) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:33:43.504493 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:33:43.552026 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f047ec93-3597-4b98-911c-7e23e6430813 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.580849 Aug 08 02:33:43.552661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 421/825] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:33:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:33:43.563962 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-740e0099-34ce-47a4-9989-18ea026d0f11 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:43.564575 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-740e0099-34ce-47a4-9989-18ea026d0f11 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:43.621819 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-740e0099-34ce-47a4-9989-18ea026d0f11 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:43.629129 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-740e0099-34ce-47a4-9989-18ea026d0f11 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1237 microversion: 2.1 time: 0.069505 Aug 08 02:33:43.629757 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 405/826] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:43 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:44.650236 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9ace7edc-e26c-420a-92f8-32309eacabbf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:44.650968 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9ace7edc-e26c-420a-92f8-32309eacabbf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:44.657733 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9ace7edc-e26c-420a-92f8-32309eacabbf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:44.658850 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9ace7edc-e26c-420a-92f8-32309eacabbf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:44.659474 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9ace7edc-e26c-420a-92f8-32309eacabbf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:44.660368 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9ace7edc-e26c-420a-92f8-32309eacabbf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:44.660935 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9ace7edc-e26c-420a-92f8-32309eacabbf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:44.661598 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9ace7edc-e26c-420a-92f8-32309eacabbf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:44.747722 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-9ace7edc-e26c-420a-92f8-32309eacabbf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:44.750363 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f6916743-21af-485b-bdf0-be38b49b8a10 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:44.750908 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f6916743-21af-485b-bdf0-be38b49b8a10 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:44.757838 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6916743-21af-485b-bdf0-be38b49b8a10 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:44.758395 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9ace7edc-e26c-420a-92f8-32309eacabbf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1307 microversion: 2.1 time: 0.113154 Aug 08 02:33:44.758529 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6916743-21af-485b-bdf0-be38b49b8a10 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:44.758948 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6916743-21af-485b-bdf0-be38b49b8a10 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:44.759081 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 422/827] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:44 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:44.760042 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6916743-21af-485b-bdf0-be38b49b8a10 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:44.760645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6916743-21af-485b-bdf0-be38b49b8a10 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:44.761217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6916743-21af-485b-bdf0-be38b49b8a10 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:44.795713 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f6916743-21af-485b-bdf0-be38b49b8a10 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:33:45.024276 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f6916743-21af-485b-bdf0-be38b49b8a10 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "DELETE /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 204 len: 0 microversion: 2.1 time: 0.277534 Aug 08 02:33:45.024852 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 406/828] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:33:44 2022] DELETE /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 02:33:45.032925 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e748adb7-4ea0-427d-8268-4701eb889d23 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:45.033535 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e748adb7-4ea0-427d-8268-4701eb889d23 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:45.039564 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e748adb7-4ea0-427d-8268-4701eb889d23 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:45.040036 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e748adb7-4ea0-427d-8268-4701eb889d23 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:45.040457 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e748adb7-4ea0-427d-8268-4701eb889d23 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:45.041137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e748adb7-4ea0-427d-8268-4701eb889d23 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:45.041577 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e748adb7-4ea0-427d-8268-4701eb889d23 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:45.041988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e748adb7-4ea0-427d-8268-4701eb889d23 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:45.256346 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e748adb7-4ea0-427d-8268-4701eb889d23 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:45.264989 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e748adb7-4ea0-427d-8268-4701eb889d23 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1509 microversion: 2.1 time: 0.235889 Aug 08 02:33:45.265559 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 423/829] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:45 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:45.780907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3f04cffc-6c1e-44e7-8559-8c61cae7071c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:45.781606 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3f04cffc-6c1e-44e7-8559-8c61cae7071c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:45.788509 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f04cffc-6c1e-44e7-8559-8c61cae7071c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:45.788990 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f04cffc-6c1e-44e7-8559-8c61cae7071c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:45.789425 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f04cffc-6c1e-44e7-8559-8c61cae7071c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:45.790115 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f04cffc-6c1e-44e7-8559-8c61cae7071c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:45.790602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f04cffc-6c1e-44e7-8559-8c61cae7071c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:45.791026 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3f04cffc-6c1e-44e7-8559-8c61cae7071c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:45.921469 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3f04cffc-6c1e-44e7-8559-8c61cae7071c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:45.929680 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3f04cffc-6c1e-44e7-8559-8c61cae7071c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1362 microversion: 2.1 time: 0.152926 Aug 08 02:33:45.930255 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 407/830] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:45 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:46.286431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dc4009fc-c311-40a5-a659-aa843de10e7a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:46.287044 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-dc4009fc-c311-40a5-a659-aa843de10e7a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:46.293510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dc4009fc-c311-40a5-a659-aa843de10e7a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:46.293988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dc4009fc-c311-40a5-a659-aa843de10e7a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:46.294467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dc4009fc-c311-40a5-a659-aa843de10e7a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:46.295161 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dc4009fc-c311-40a5-a659-aa843de10e7a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:46.295616 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dc4009fc-c311-40a5-a659-aa843de10e7a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:46.296040 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dc4009fc-c311-40a5-a659-aa843de10e7a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:46.628437 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-dc4009fc-c311-40a5-a659-aa843de10e7a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:46.635767 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-dc4009fc-c311-40a5-a659-aa843de10e7a tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 200 len: 1509 microversion: 2.1 time: 0.353860 Aug 08 02:33:46.636366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 424/831] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:46 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 1509 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:46.798660 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-a88d11e6-3b05-4773-8ea3-0d01340d830b req-744958de-752d-4d91-997e-7451f4991e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13364414-05f0-413b-bd7e-27ad8c210e32", "name": "network-vif-deleted", "tag": "dbb78041-5c91-4099-9e3f-6221c1a48511"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:46.809654 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a88d11e6-3b05-4773-8ea3-0d01340d830b req-744958de-752d-4d91-997e-7451f4991e58 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:46.810549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a88d11e6-3b05-4773-8ea3-0d01340d830b req-744958de-752d-4d91-997e-7451f4991e58 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:46.811333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a88d11e6-3b05-4773-8ea3-0d01340d830b req-744958de-752d-4d91-997e-7451f4991e58 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:46.825155 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-a88d11e6-3b05-4773-8ea3-0d01340d830b req-744958de-752d-4d91-997e-7451f4991e58 service nova] Creating event network-vif-deleted:dbb78041-5c91-4099-9e3f-6221c1a48511 for instance 13364414-05f0-413b-bd7e-27ad8c210e32 on hv-cinder-73306 Aug 08 02:33:46.831563 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-a88d11e6-3b05-4773-8ea3-0d01340d830b req-744958de-752d-4d91-997e-7451f4991e58 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036101 Aug 08 02:33:46.832441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 408/832] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:33:46.950916 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9de30472-17a3-4260-81bf-354e51c3fd58 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:46.951522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9de30472-17a3-4260-81bf-354e51c3fd58 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:46.957780 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9de30472-17a3-4260-81bf-354e51c3fd58 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:46.958239 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9de30472-17a3-4260-81bf-354e51c3fd58 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:46.958720 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9de30472-17a3-4260-81bf-354e51c3fd58 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:46.959424 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9de30472-17a3-4260-81bf-354e51c3fd58 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:46.959868 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9de30472-17a3-4260-81bf-354e51c3fd58 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:46.960292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9de30472-17a3-4260-81bf-354e51c3fd58 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:47.106001 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-9de30472-17a3-4260-81bf-354e51c3fd58 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:47.114268 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9de30472-17a3-4260-81bf-354e51c3fd58 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1362 microversion: 2.1 time: 0.167075 Aug 08 02:33:47.114887 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 425/833] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:46 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:47.657403 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-59273439-59d6-45d8-b386-aa3facdefe28 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:47.658129 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-59273439-59d6-45d8-b386-aa3facdefe28 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 13364414-05f0-413b-bd7e-27ad8c210e32] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:47.664854 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59273439-59d6-45d8-b386-aa3facdefe28 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:47.665333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59273439-59d6-45d8-b386-aa3facdefe28 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:47.665765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59273439-59d6-45d8-b386-aa3facdefe28 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:47.666477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59273439-59d6-45d8-b386-aa3facdefe28 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:47.666926 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59273439-59d6-45d8-b386-aa3facdefe28 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:47.667345 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59273439-59d6-45d8-b386-aa3facdefe28 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:47.680231 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-59273439-59d6-45d8-b386-aa3facdefe28 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] HTTP exception thrown: Instance 13364414-05f0-413b-bd7e-27ad8c210e32 could not be found. Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-59273439-59d6-45d8-b386-aa3facdefe28 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Request method failure captured: Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 HTTP/1.1 Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQj7nZ596tyWWWEdcaGznu-Z4Br4Pom5I2-PAdLAUN_l4GI5DRgq5KfI9Fl4w_rhUMWFPKnZ3O16ZNtof9AdmY2rGF26JlAQcLDANOgMx4S2l8JMiyb147J-pdIPWo7r6B24FrJ8_yahhcB2zBycszIcITthdplKZyyjWZU9pJnJXE Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 12bf9f0d74de4a57918b688a6d969b28 Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:33:47.681817 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:33:47.683344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12bf9f0d74de4a57918b688a6d969b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12bf9f0d74de4a57918b688a6d969b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12bf9f0d74de4a57918b688a6d969b28", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12bf9f0d74de4a57918b688a6d969b28"}]}] Aug 08 02:33:47.683344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:33:47.683344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 12bf9f0d74de4a57918b688a6d969b28 Aug 08 02:33:47.683344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:33:47.683344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-ServerRescueNegativeTestJSON-561377719-project Aug 08 02:33:47.683344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:33:47.683344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:33:47.683344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 1fd1b40cbd884915bdfac150f9718e32 Aug 08 02:33:47.683344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-561377719-project Aug 08 02:33:47.683344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:33:47.683344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 13364414-05f0-413b-bd7e-27ad8c210e32 could not be found. Aug 08 02:33:47.683344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '13364414-05f0-413b-bd7e-27ad8c210e32'} Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13364414-05f0-413b-bd7e-27ad8c210e32 could not be found. Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:33:47.684140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13364414-05f0-413b-bd7e-27ad8c210e32 could not be found. Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13364414-05f0-413b-bd7e-27ad8c210e32 could not be found. Aug 08 02:33:47.685545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:47.687017 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-59273439-59d6-45d8-b386-aa3facdefe28 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Returning 404 to user: Instance 13364414-05f0-413b-bd7e-27ad8c210e32 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:33:47.687017 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-59273439-59d6-45d8-b386-aa3facdefe28 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32" status: 404 len: 111 microversion: 2.1 time: 0.030102 Aug 08 02:33:47.687017 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 409/834] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:47 2022] GET /compute/v2.1/servers/13364414-05f0-413b-bd7e-27ad8c210e32 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:33:47.691914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-287583cf-715c-42ff-93b9-20af3d63943b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:47.692408 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-287583cf-715c-42ff-93b9-20af3d63943b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:47.698877 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-287583cf-715c-42ff-93b9-20af3d63943b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:47.699359 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-287583cf-715c-42ff-93b9-20af3d63943b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:47.699789 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-287583cf-715c-42ff-93b9-20af3d63943b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:47.700468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-287583cf-715c-42ff-93b9-20af3d63943b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:47.700916 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-287583cf-715c-42ff-93b9-20af3d63943b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:47.701333 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-287583cf-715c-42ff-93b9-20af3d63943b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:47.705366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:47.729870 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-287583cf-715c-42ff-93b9-20af3d63943b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:33:47.802741 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-287583cf-715c-42ff-93b9-20af3d63943b tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "DELETE /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 204 len: 0 microversion: 2.1 time: 0.114639 Aug 08 02:33:47.803326 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 426/835] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:33:47 2022] DELETE /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:33:47.811229 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f870da32-b54c-4018-9044-97e72d75d676 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:47.811870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f870da32-b54c-4018-9044-97e72d75d676 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:47.818431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f870da32-b54c-4018-9044-97e72d75d676 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:47.818907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f870da32-b54c-4018-9044-97e72d75d676 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:47.819341 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f870da32-b54c-4018-9044-97e72d75d676 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:47.820023 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f870da32-b54c-4018-9044-97e72d75d676 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:47.820473 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f870da32-b54c-4018-9044-97e72d75d676 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:47.820893 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f870da32-b54c-4018-9044-97e72d75d676 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:47.953062 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f870da32-b54c-4018-9044-97e72d75d676 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:47.957226 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:47.962668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f870da32-b54c-4018-9044-97e72d75d676 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1522 microversion: 2.1 time: 0.155197 Aug 08 02:33:47.963260 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 410/836] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:47 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:48.135346 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ec931a71-afc8-4852-80b1-9ba599331cef tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:48.136032 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ec931a71-afc8-4852-80b1-9ba599331cef tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:48.141956 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec931a71-afc8-4852-80b1-9ba599331cef tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:48.142404 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec931a71-afc8-4852-80b1-9ba599331cef tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:48.142835 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec931a71-afc8-4852-80b1-9ba599331cef tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:48.144075 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec931a71-afc8-4852-80b1-9ba599331cef tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:48.144524 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec931a71-afc8-4852-80b1-9ba599331cef tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:48.144937 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec931a71-afc8-4852-80b1-9ba599331cef tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:48.278624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ec931a71-afc8-4852-80b1-9ba599331cef tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:48.286109 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ec931a71-afc8-4852-80b1-9ba599331cef tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1362 microversion: 2.1 time: 0.154974 Aug 08 02:33:48.286698 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 427/837] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:48 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:48.846120 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-69ea118c-8d1c-4032-8547-0370739306b7 req-ed39eb63-6690-4602-8881-a04bf4b92b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7c1eeb6-26c2-4706-8b39-0f233449617a", "tag": "70635be5-8521-49ef-a849-31a2ed0e85ee"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:48.857988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-69ea118c-8d1c-4032-8547-0370739306b7 req-ed39eb63-6690-4602-8881-a04bf4b92b1e service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:48.858540 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-69ea118c-8d1c-4032-8547-0370739306b7 req-ed39eb63-6690-4602-8881-a04bf4b92b1e service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:48.858968 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-69ea118c-8d1c-4032-8547-0370739306b7 req-ed39eb63-6690-4602-8881-a04bf4b92b1e service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:48.870343 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-69ea118c-8d1c-4032-8547-0370739306b7 req-ed39eb63-6690-4602-8881-a04bf4b92b1e service nova] Creating event network-changed:70635be5-8521-49ef-a849-31a2ed0e85ee for instance c7c1eeb6-26c2-4706-8b39-0f233449617a on hv-cinder-73306 Aug 08 02:33:48.876177 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-69ea118c-8d1c-4032-8547-0370739306b7 req-ed39eb63-6690-4602-8881-a04bf4b92b1e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033960 Aug 08 02:33:48.876727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 411/838] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:33:48.983250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1d18d019-96d1-428a-9172-52a864dd0b4c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:48.983885 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1d18d019-96d1-428a-9172-52a864dd0b4c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:48.990918 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1d18d019-96d1-428a-9172-52a864dd0b4c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:48.991389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1d18d019-96d1-428a-9172-52a864dd0b4c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:48.991820 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1d18d019-96d1-428a-9172-52a864dd0b4c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:48.992493 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1d18d019-96d1-428a-9172-52a864dd0b4c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:48.992942 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1d18d019-96d1-428a-9172-52a864dd0b4c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:48.993358 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1d18d019-96d1-428a-9172-52a864dd0b4c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:49.119076 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1d18d019-96d1-428a-9172-52a864dd0b4c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:49.126482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1d18d019-96d1-428a-9172-52a864dd0b4c tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1522 microversion: 2.1 time: 0.146992 Aug 08 02:33:49.127047 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 428/839] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:48 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:49.307022 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-db1c2fee-12ab-4a93-8ee4-82a47ca289d2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:49.307726 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-db1c2fee-12ab-4a93-8ee4-82a47ca289d2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:49.313818 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db1c2fee-12ab-4a93-8ee4-82a47ca289d2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:49.314330 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db1c2fee-12ab-4a93-8ee4-82a47ca289d2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:49.314764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db1c2fee-12ab-4a93-8ee4-82a47ca289d2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:49.315697 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db1c2fee-12ab-4a93-8ee4-82a47ca289d2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:49.316147 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db1c2fee-12ab-4a93-8ee4-82a47ca289d2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:49.316567 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db1c2fee-12ab-4a93-8ee4-82a47ca289d2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:49.445597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-db1c2fee-12ab-4a93-8ee4-82a47ca289d2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:49.453093 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-db1c2fee-12ab-4a93-8ee4-82a47ca289d2 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1362 microversion: 2.1 time: 0.150227 Aug 08 02:33:49.453649 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 412/840] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:49 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:50.147078 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6e43520e-6a99-451e-abdd-2b9c12f9f7cb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:50.147688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6e43520e-6a99-451e-abdd-2b9c12f9f7cb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:50.154084 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e43520e-6a99-451e-abdd-2b9c12f9f7cb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:50.154601 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e43520e-6a99-451e-abdd-2b9c12f9f7cb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:50.155031 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e43520e-6a99-451e-abdd-2b9c12f9f7cb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:50.155709 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e43520e-6a99-451e-abdd-2b9c12f9f7cb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:50.156157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e43520e-6a99-451e-abdd-2b9c12f9f7cb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:50.156575 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-6e43520e-6a99-451e-abdd-2b9c12f9f7cb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:50.355913 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6e43520e-6a99-451e-abdd-2b9c12f9f7cb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:50.363974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6e43520e-6a99-451e-abdd-2b9c12f9f7cb tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1522 microversion: 2.1 time: 0.220763 Aug 08 02:33:50.364576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 429/841] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:50 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:50.474106 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-efe78e44-1425-4be0-a6cc-457daea39073 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:50.474803 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-efe78e44-1425-4be0-a6cc-457daea39073 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:50.481158 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efe78e44-1425-4be0-a6cc-457daea39073 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:50.481640 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efe78e44-1425-4be0-a6cc-457daea39073 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:50.482075 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efe78e44-1425-4be0-a6cc-457daea39073 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:50.482796 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efe78e44-1425-4be0-a6cc-457daea39073 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:50.483250 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efe78e44-1425-4be0-a6cc-457daea39073 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:50.483677 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-efe78e44-1425-4be0-a6cc-457daea39073 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:50.618686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-efe78e44-1425-4be0-a6cc-457daea39073 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:50.625991 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-efe78e44-1425-4be0-a6cc-457daea39073 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1362 microversion: 2.1 time: 0.156255 Aug 08 02:33:50.626576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 413/842] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:50 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:51.372718 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-6b341135-3ff2-4892-892e-d15b3822f399 req-b9288119-e2d9-4b55-8034-e4915ce52aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b248f4-c0a5-4bf3-b424-5e953068e4a5", "name": "network-vif-deleted", "tag": "9b89e848-9490-437b-b21c-d15edb41b4c4"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:51.383869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-6b341135-3ff2-4892-892e-d15b3822f399 req-b9288119-e2d9-4b55-8034-e4915ce52aa3 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:51.384267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-6b341135-3ff2-4892-892e-d15b3822f399 req-b9288119-e2d9-4b55-8034-e4915ce52aa3 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:51.384703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-6b341135-3ff2-4892-892e-d15b3822f399 req-b9288119-e2d9-4b55-8034-e4915ce52aa3 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:51.385143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e4123dd1-ace6-4ffb-8dcc-39127c34202f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:51.385762 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e4123dd1-ace6-4ffb-8dcc-39127c34202f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:51.391910 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4123dd1-ace6-4ffb-8dcc-39127c34202f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:51.397151 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4123dd1-ace6-4ffb-8dcc-39127c34202f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:51.397443 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4123dd1-ace6-4ffb-8dcc-39127c34202f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:51.398395 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4123dd1-ace6-4ffb-8dcc-39127c34202f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:51.398847 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4123dd1-ace6-4ffb-8dcc-39127c34202f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:51.399345 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-6b341135-3ff2-4892-892e-d15b3822f399 req-b9288119-e2d9-4b55-8034-e4915ce52aa3 service nova] Creating event network-vif-deleted:9b89e848-9490-437b-b21c-d15edb41b4c4 for instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 on hv-cinder-73306 Aug 08 02:33:51.399476 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4123dd1-ace6-4ffb-8dcc-39127c34202f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:51.404385 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-6b341135-3ff2-4892-892e-d15b3822f399 req-b9288119-e2d9-4b55-8034-e4915ce52aa3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035333 Aug 08 02:33:51.404970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 430/843] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:33:51.469073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e4123dd1-ace6-4ffb-8dcc-39127c34202f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd1b40cbd884915bdfac150f9718e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bf9f0d74de4a57918b688a6d969b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:51.478273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e4123dd1-ace6-4ffb-8dcc-39127c34202f tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 200 len: 1306 microversion: 2.1 time: 0.096956 Aug 08 02:33:51.479115 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 414/844] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:51 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:51.647101 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7767e396-025c-4e22-8654-47596c900308 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:51.647808 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7767e396-025c-4e22-8654-47596c900308 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:51.654581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7767e396-025c-4e22-8654-47596c900308 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:51.655064 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7767e396-025c-4e22-8654-47596c900308 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:51.655494 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7767e396-025c-4e22-8654-47596c900308 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:51.656371 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7767e396-025c-4e22-8654-47596c900308 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:51.656820 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7767e396-025c-4e22-8654-47596c900308 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:51.657237 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7767e396-025c-4e22-8654-47596c900308 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:51.794959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7767e396-025c-4e22-8654-47596c900308 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:51.803130 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7767e396-025c-4e22-8654-47596c900308 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1362 microversion: 2.1 time: 0.160280 Aug 08 02:33:51.803696 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 431/845] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:51 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:52.500333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3efdcc7a-1a80-48d4-a86e-2016724ab3b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:52.500948 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3efdcc7a-1a80-48d4-a86e-2016724ab3b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] [instance: 44b248f4-c0a5-4bf3-b424-5e953068e4a5] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:52.509277 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3efdcc7a-1a80-48d4-a86e-2016724ab3b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:52.510131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3efdcc7a-1a80-48d4-a86e-2016724ab3b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:52.510597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3efdcc7a-1a80-48d4-a86e-2016724ab3b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:52.511302 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3efdcc7a-1a80-48d4-a86e-2016724ab3b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:52.511757 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3efdcc7a-1a80-48d4-a86e-2016724ab3b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:52.512177 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3efdcc7a-1a80-48d4-a86e-2016724ab3b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:52.526489 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-3efdcc7a-1a80-48d4-a86e-2016724ab3b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] HTTP exception thrown: Instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 could not be found. Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3efdcc7a-1a80-48d4-a86e-2016724ab3b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Request method failure captured: Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 HTTP/1.1 Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQj7nZ596tyWWWEdcaGznu-Z4Br4Pom5I2-PAdLAUN_l4GI5DRgq5KfI9Fl4w_rhUMWFPKnZ3O16ZNtof9AdmY2rGF26JlAQcLDANOgMx4S2l8JMiyb147J-pdIPWo7r6B24FrJ8_yahhcB2zBycszIcITthdplKZyyjWZU9pJnJXE Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 12bf9f0d74de4a57918b688a6d969b28 Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:33:52.528225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:33:52.529800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12bf9f0d74de4a57918b688a6d969b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12bf9f0d74de4a57918b688a6d969b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12bf9f0d74de4a57918b688a6d969b28", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12bf9f0d74de4a57918b688a6d969b28"}]}] Aug 08 02:33:52.529800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:33:52.529800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 12bf9f0d74de4a57918b688a6d969b28 Aug 08 02:33:52.529800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-561377719 Aug 08 02:33:52.529800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-ServerRescueNegativeTestJSON-561377719-project Aug 08 02:33:52.529800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:33:52.529800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:33:52.529800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 1fd1b40cbd884915bdfac150f9718e32 Aug 08 02:33:52.529800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-561377719-project Aug 08 02:33:52.529800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:33:52.529800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 could not be found. Aug 08 02:33:52.529800 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '44b248f4-c0a5-4bf3-b424-5e953068e4a5'} Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 could not be found. Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:33:52.530626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 could not be found. Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 could not be found. Aug 08 02:33:52.531765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:33:52.532808 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3efdcc7a-1a80-48d4-a86e-2016724ab3b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] Returning 404 to user: Instance 44b248f4-c0a5-4bf3-b424-5e953068e4a5 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:33:52.532808 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3efdcc7a-1a80-48d4-a86e-2016724ab3b6 tempest-ServerRescueNegativeTestJSON-561377719 tempest-ServerRescueNegativeTestJSON-561377719-project] 10.222.0.39 "GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5" status: 404 len: 111 microversion: 2.1 time: 0.033329 Aug 08 02:33:52.532808 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 415/846] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:52 2022] GET /compute/v2.1/servers/44b248f4-c0a5-4bf3-b424-5e953068e4a5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:33:52.823561 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dd62b234-6680-4d54-a530-0fc4e21a3378 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:52.824204 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-dd62b234-6680-4d54-a530-0fc4e21a3378 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:52.830581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dd62b234-6680-4d54-a530-0fc4e21a3378 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:52.831064 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dd62b234-6680-4d54-a530-0fc4e21a3378 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:52.831496 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dd62b234-6680-4d54-a530-0fc4e21a3378 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:52.832183 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dd62b234-6680-4d54-a530-0fc4e21a3378 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:52.832632 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dd62b234-6680-4d54-a530-0fc4e21a3378 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:52.833058 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dd62b234-6680-4d54-a530-0fc4e21a3378 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:52.964852 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-dd62b234-6680-4d54-a530-0fc4e21a3378 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:52.972393 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-dd62b234-6680-4d54-a530-0fc4e21a3378 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1362 microversion: 2.1 time: 0.152759 Aug 08 02:33:52.972957 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 432/847] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:52 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:53.993319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ea85138e-529b-4cf6-a8ad-47b8ab86d941 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:53.994223 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ea85138e-529b-4cf6-a8ad-47b8ab86d941 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:53.997964 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:54.001507 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea85138e-529b-4cf6-a8ad-47b8ab86d941 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:54.001985 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea85138e-529b-4cf6-a8ad-47b8ab86d941 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:54.002452 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea85138e-529b-4cf6-a8ad-47b8ab86d941 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:54.003825 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea85138e-529b-4cf6-a8ad-47b8ab86d941 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:54.004271 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea85138e-529b-4cf6-a8ad-47b8ab86d941 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:54.004984 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea85138e-529b-4cf6-a8ad-47b8ab86d941 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:54.237918 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ea85138e-529b-4cf6-a8ad-47b8ab86d941 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:54.245368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ea85138e-529b-4cf6-a8ad-47b8ab86d941 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1362 microversion: 2.1 time: 0.256187 Aug 08 02:33:54.246240 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 416/848] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:53 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:54.504328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-22ac1ceb-5d57-4330-a805-535b96dea9c6 req-5feff056-3dbf-49e5-a42b-7a475e95a5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7c1eeb6-26c2-4706-8b39-0f233449617a", "name": "network-vif-plugged", "status": "completed", "tag": "70635be5-8521-49ef-a849-31a2ed0e85ee"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:54.509194 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:54.509845 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=6 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:33:54.518163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-22ac1ceb-5d57-4330-a805-535b96dea9c6 req-5feff056-3dbf-49e5-a42b-7a475e95a5a7 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:54.519337 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-22ac1ceb-5d57-4330-a805-535b96dea9c6 req-5feff056-3dbf-49e5-a42b-7a475e95a5a7 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:54.520017 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-22ac1ceb-5d57-4330-a805-535b96dea9c6 req-5feff056-3dbf-49e5-a42b-7a475e95a5a7 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:54.541643 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-22ac1ceb-5d57-4330-a805-535b96dea9c6 req-5feff056-3dbf-49e5-a42b-7a475e95a5a7 service nova] Creating event network-vif-plugged:70635be5-8521-49ef-a849-31a2ed0e85ee for instance c7c1eeb6-26c2-4706-8b39-0f233449617a on hv-cinder-73306 Aug 08 02:33:54.550729 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-22ac1ceb-5d57-4330-a805-535b96dea9c6 req-5feff056-3dbf-49e5-a42b-7a475e95a5a7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049627 Aug 08 02:33:54.552279 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 433/849] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:33:55.265991 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a8614c54-dbab-4c1f-a259-5db73a3e71ae tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:55.266762 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a8614c54-dbab-4c1f-a259-5db73a3e71ae tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:55.273565 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8614c54-dbab-4c1f-a259-5db73a3e71ae tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:55.274031 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8614c54-dbab-4c1f-a259-5db73a3e71ae tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:55.274494 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8614c54-dbab-4c1f-a259-5db73a3e71ae tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:55.275174 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8614c54-dbab-4c1f-a259-5db73a3e71ae tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:55.275619 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8614c54-dbab-4c1f-a259-5db73a3e71ae tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:55.276033 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8614c54-dbab-4c1f-a259-5db73a3e71ae tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:55.478462 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a8614c54-dbab-4c1f-a259-5db73a3e71ae tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:55.486145 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a8614c54-dbab-4c1f-a259-5db73a3e71ae tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1362 microversion: 2.1 time: 0.224091 Aug 08 02:33:55.486901 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 417/850] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:55 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:56.507601 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f614e94d-8fcd-4df1-88d5-d4c9416c66ff tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:56.508455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f614e94d-8fcd-4df1-88d5-d4c9416c66ff tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:56.517261 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f614e94d-8fcd-4df1-88d5-d4c9416c66ff tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:56.517742 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f614e94d-8fcd-4df1-88d5-d4c9416c66ff tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:56.518688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f614e94d-8fcd-4df1-88d5-d4c9416c66ff tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:56.519409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f614e94d-8fcd-4df1-88d5-d4c9416c66ff tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:56.519853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f614e94d-8fcd-4df1-88d5-d4c9416c66ff tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:56.520393 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f614e94d-8fcd-4df1-88d5-d4c9416c66ff tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:56.653832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f614e94d-8fcd-4df1-88d5-d4c9416c66ff tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:56.662672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f614e94d-8fcd-4df1-88d5-d4c9416c66ff tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1362 microversion: 2.1 time: 0.159287 Aug 08 02:33:56.663240 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 434/851] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:56 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:33:57.683378 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-901b5c2f-651f-48dd-9d6a-d810798a0aaa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:57.683997 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-901b5c2f-651f-48dd-9d6a-d810798a0aaa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:57.690910 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-901b5c2f-651f-48dd-9d6a-d810798a0aaa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:57.691472 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-901b5c2f-651f-48dd-9d6a-d810798a0aaa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:57.691994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-901b5c2f-651f-48dd-9d6a-d810798a0aaa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:57.692787 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-901b5c2f-651f-48dd-9d6a-d810798a0aaa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:57.693322 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-901b5c2f-651f-48dd-9d6a-d810798a0aaa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:57.693812 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-901b5c2f-651f-48dd-9d6a-d810798a0aaa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:57.858463 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-901b5c2f-651f-48dd-9d6a-d810798a0aaa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:33:57.867082 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-901b5c2f-651f-48dd-9d6a-d810798a0aaa tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1548 microversion: 2.1 time: 0.187453 Aug 08 02:33:57.867643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 418/852] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:33:57 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1548 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:33:57.887734 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3001d401-8d34-48cf-8dfe-95792ec8034e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:33:57.888226 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3001d401-8d34-48cf-8dfe-95792ec8034e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:33:57.895942 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3001d401-8d34-48cf-8dfe-95792ec8034e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:57.896648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3001d401-8d34-48cf-8dfe-95792ec8034e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:57.897291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3001d401-8d34-48cf-8dfe-95792ec8034e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:57.898205 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3001d401-8d34-48cf-8dfe-95792ec8034e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:57.899048 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3001d401-8d34-48cf-8dfe-95792ec8034e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:57.899270 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3001d401-8d34-48cf-8dfe-95792ec8034e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:57.987695 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3001d401-8d34-48cf-8dfe-95792ec8034e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103215 Aug 08 02:33:57.988288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 435/853] 10.222.0.39 () {58 vars in 1275 bytes} [Mon Aug 8 02:33:57 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:33:59.299385 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-c7802959-d64f-4cae-bce9-9374eb7afda6 req-499a1701-fc77-4baa-8076-f7147108ca89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7c1eeb6-26c2-4706-8b39-0f233449617a", "tag": "70635be5-8521-49ef-a849-31a2ed0e85ee"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:33:59.312772 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-c7802959-d64f-4cae-bce9-9374eb7afda6 req-499a1701-fc77-4baa-8076-f7147108ca89 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:33:59.313349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-c7802959-d64f-4cae-bce9-9374eb7afda6 req-499a1701-fc77-4baa-8076-f7147108ca89 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:33:59.313855 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-c7802959-d64f-4cae-bce9-9374eb7afda6 req-499a1701-fc77-4baa-8076-f7147108ca89 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:33:59.332645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-c7802959-d64f-4cae-bce9-9374eb7afda6 req-499a1701-fc77-4baa-8076-f7147108ca89 service nova] Creating event network-changed:70635be5-8521-49ef-a849-31a2ed0e85ee for instance c7c1eeb6-26c2-4706-8b39-0f233449617a on hv-cinder-73306 Aug 08 02:33:59.339625 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-c7802959-d64f-4cae-bce9-9374eb7afda6 req-499a1701-fc77-4baa-8076-f7147108ca89 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044354 Aug 08 02:33:59.344478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 419/854] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:01.858212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b707c6d2-3701-40e2-9463-9bf04d57a613 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Action: 'create', calling method: .version_select at 0x7f32950f2700>, body: {"keypair": {"name": "tempest-keypair-811407261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIk8Ux8ZCW16UFTc0CCTPMdSc1+U5fbbsBxjcujeKopQaUNaQU2nowA+/sAZa8Pxo9mRQNZpfnInfng4slziDj32w3lv16MQoQldqF5eCzunBNfLXYz9Kiky1pn7J5euCw=="}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:01.874937 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-b707c6d2-3701-40e2-9463-9bf04d57a613 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Getting quotas for project 6dcedd52439b47689047813e0566ba78. Resources: {'key_pairs'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:34:01.879428 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-b707c6d2-3701-40e2-9463-9bf04d57a613 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Getting quotas for user 5de4e28bfee14bae93c7f7a8f3f098fc and project 6dcedd52439b47689047813e0566ba78. Resources: {'key_pairs'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:34:01.883615 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:01.912732 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b707c6d2-3701-40e2-9463-9bf04d57a613 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.221685 Aug 08 02:34:01.913984 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 436/855] 10.222.0.39 () {62 vars in 1200 bytes} [Mon Aug 8 02:34:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 224 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 02:34:03.191138 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-932713686", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b082417f-df0b-4b13-b79d-d6bf9807755d"}], "security_groups": [{"name": "tempest-securitygroup--1769005973"}], "key_name": "tempest-keypair-811407261", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:03.296576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] validate_networks() for [('b082417f-df0b-4b13-b79d-d6bf9807755d', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:34:03.492936 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:34:03.493127 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Mon Aug 8 02:34:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Aug 08 02:34:03.694010 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:34:03.694764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:34:03.695239 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:34:03.695668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:34:03.696250 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:34:03.705196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:03.706137 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:03.706803 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:03.707787 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:03.708432 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:03.712877 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:03.730331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Getting quotas for project 6dcedd52439b47689047813e0566ba78. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:34:03.734210 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Getting quotas for user 5de4e28bfee14bae93c7f7a8f3f098fc and project 6dcedd52439b47689047813e0566ba78. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:34:03.744977 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:34:03.747363 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:34:03.795913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0d73c3ea-7b4f-4ce0-bd9a-fa9a6c38ccd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.609747 Aug 08 02:34:03.799445 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 420/856] 10.222.0.39 () {62 vars in 1188 bytes} [Mon Aug 8 02:34:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 02:34:03.808090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-16dd6f39-25f9-4cbc-8026-b51d9a897e34 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:03.808689 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-16dd6f39-25f9-4cbc-8026-b51d9a897e34 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:03.866383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-16dd6f39-25f9-4cbc-8026-b51d9a897e34 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:03.875098 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-16dd6f39-25f9-4cbc-8026-b51d9a897e34 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:03.876600 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-16dd6f39-25f9-4cbc-8026-b51d9a897e34 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:03.878214 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-16dd6f39-25f9-4cbc-8026-b51d9a897e34 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1280 microversion: 2.20 time: 0.074543 Aug 08 02:34:03.878792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 437/857] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:34:03 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:34:04.901050 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-700796a7-24f2-4dbb-9f02-73b929e4f4b5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:04.902463 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-700796a7-24f2-4dbb-9f02-73b929e4f4b5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:04.904807 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:04.910543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-700796a7-24f2-4dbb-9f02-73b929e4f4b5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:04.911410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-700796a7-24f2-4dbb-9f02-73b929e4f4b5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:04.912019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-700796a7-24f2-4dbb-9f02-73b929e4f4b5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:04.912747 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-700796a7-24f2-4dbb-9f02-73b929e4f4b5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:04.913199 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-700796a7-24f2-4dbb-9f02-73b929e4f4b5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:04.913666 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-700796a7-24f2-4dbb-9f02-73b929e4f4b5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:04.988196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-700796a7-24f2-4dbb-9f02-73b929e4f4b5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:04.996339 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-700796a7-24f2-4dbb-9f02-73b929e4f4b5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:04.997828 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-700796a7-24f2-4dbb-9f02-73b929e4f4b5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:04.998943 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-700796a7-24f2-4dbb-9f02-73b929e4f4b5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1340 microversion: 2.20 time: 0.102111 Aug 08 02:34:04.999486 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 421/858] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:34:04 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1340 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:34:06.022144 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4558871e-96bb-4cc5-8d15-4391d6c310b4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:06.023452 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4558871e-96bb-4cc5-8d15-4391d6c310b4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:06.029862 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4558871e-96bb-4cc5-8d15-4391d6c310b4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:06.030372 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4558871e-96bb-4cc5-8d15-4391d6c310b4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:06.030797 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4558871e-96bb-4cc5-8d15-4391d6c310b4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:06.031477 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4558871e-96bb-4cc5-8d15-4391d6c310b4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:06.031918 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4558871e-96bb-4cc5-8d15-4391d6c310b4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:06.032330 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4558871e-96bb-4cc5-8d15-4391d6c310b4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:06.260648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4558871e-96bb-4cc5-8d15-4391d6c310b4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:06.268567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4558871e-96bb-4cc5-8d15-4391d6c310b4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:06.270062 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4558871e-96bb-4cc5-8d15-4391d6c310b4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:06.271179 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4558871e-96bb-4cc5-8d15-4391d6c310b4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1406 microversion: 2.20 time: 0.253527 Aug 08 02:34:06.271729 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 438/859] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:34:06 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:34:06.394760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-07e6ff15-abaa-4370-a48c-3e4da34472aa req-00cb5aa2-d4af-46a4-904b-061995fdc7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614b1928-9870-453b-8bf7-7b21f36ed2be", "tag": "2d321e72-03cd-4396-9683-df053c6107d1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:06.404686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-07e6ff15-abaa-4370-a48c-3e4da34472aa req-00cb5aa2-d4af-46a4-904b-061995fdc7e4 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:06.405208 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-07e6ff15-abaa-4370-a48c-3e4da34472aa req-00cb5aa2-d4af-46a4-904b-061995fdc7e4 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:06.405821 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-07e6ff15-abaa-4370-a48c-3e4da34472aa req-00cb5aa2-d4af-46a4-904b-061995fdc7e4 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:06.416646 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-07e6ff15-abaa-4370-a48c-3e4da34472aa req-00cb5aa2-d4af-46a4-904b-061995fdc7e4 service nova] Creating event network-changed:2d321e72-03cd-4396-9683-df053c6107d1 for instance 614b1928-9870-453b-8bf7-7b21f36ed2be on hv-cinder-73306 Aug 08 02:34:06.421297 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-07e6ff15-abaa-4370-a48c-3e4da34472aa req-00cb5aa2-d4af-46a4-904b-061995fdc7e4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030572 Aug 08 02:34:06.422188 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 422/860] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:07.293492 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0085189c-73bc-40de-b38d-8427ab005963 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:07.294098 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0085189c-73bc-40de-b38d-8427ab005963 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:07.300288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0085189c-73bc-40de-b38d-8427ab005963 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:07.300761 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0085189c-73bc-40de-b38d-8427ab005963 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:07.301190 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0085189c-73bc-40de-b38d-8427ab005963 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:07.301870 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0085189c-73bc-40de-b38d-8427ab005963 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:07.302344 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0085189c-73bc-40de-b38d-8427ab005963 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:07.302765 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0085189c-73bc-40de-b38d-8427ab005963 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:07.431871 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0085189c-73bc-40de-b38d-8427ab005963 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:07.440234 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0085189c-73bc-40de-b38d-8427ab005963 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:07.441746 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0085189c-73bc-40de-b38d-8427ab005963 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:07.442867 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0085189c-73bc-40de-b38d-8427ab005963 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1406 microversion: 2.20 time: 0.153255 Aug 08 02:34:07.443424 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 439/861] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:34:07 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:34:08.466855 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ce1d770b-6c6f-4acf-a6e4-c4d3117a5b1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:08.468372 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ce1d770b-6c6f-4acf-a6e4-c4d3117a5b1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:08.474778 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce1d770b-6c6f-4acf-a6e4-c4d3117a5b1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:08.475263 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce1d770b-6c6f-4acf-a6e4-c4d3117a5b1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:08.475700 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce1d770b-6c6f-4acf-a6e4-c4d3117a5b1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:08.476395 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce1d770b-6c6f-4acf-a6e4-c4d3117a5b1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:08.476851 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce1d770b-6c6f-4acf-a6e4-c4d3117a5b1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:08.477277 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce1d770b-6c6f-4acf-a6e4-c4d3117a5b1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:08.603501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ce1d770b-6c6f-4acf-a6e4-c4d3117a5b1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:08.611404 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ce1d770b-6c6f-4acf-a6e4-c4d3117a5b1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:08.613438 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ce1d770b-6c6f-4acf-a6e4-c4d3117a5b1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:08.614571 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ce1d770b-6c6f-4acf-a6e4-c4d3117a5b1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1406 microversion: 2.20 time: 0.153339 Aug 08 02:34:08.615130 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 423/862] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:34:08 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:34:09.636922 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7ca3d8d8-31d5-4f77-9a64-cfd7cebdcd1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:09.637526 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7ca3d8d8-31d5-4f77-9a64-cfd7cebdcd1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:09.644537 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7ca3d8d8-31d5-4f77-9a64-cfd7cebdcd1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:09.645013 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7ca3d8d8-31d5-4f77-9a64-cfd7cebdcd1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:09.645445 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7ca3d8d8-31d5-4f77-9a64-cfd7cebdcd1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:09.646129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7ca3d8d8-31d5-4f77-9a64-cfd7cebdcd1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:09.646616 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7ca3d8d8-31d5-4f77-9a64-cfd7cebdcd1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:09.647038 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7ca3d8d8-31d5-4f77-9a64-cfd7cebdcd1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:09.852381 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7ca3d8d8-31d5-4f77-9a64-cfd7cebdcd1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:09.860472 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7ca3d8d8-31d5-4f77-9a64-cfd7cebdcd1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:09.862091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7ca3d8d8-31d5-4f77-9a64-cfd7cebdcd1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:09.863264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7ca3d8d8-31d5-4f77-9a64-cfd7cebdcd1b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1406 microversion: 2.20 time: 0.230262 Aug 08 02:34:09.863820 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 440/863] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:34:09 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:34:10.886104 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9d12decc-e5ae-4069-a7a9-8f9f47527dbd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:10.886749 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9d12decc-e5ae-4069-a7a9-8f9f47527dbd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:10.893650 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d12decc-e5ae-4069-a7a9-8f9f47527dbd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:10.894129 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d12decc-e5ae-4069-a7a9-8f9f47527dbd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:10.894598 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d12decc-e5ae-4069-a7a9-8f9f47527dbd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:10.895283 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d12decc-e5ae-4069-a7a9-8f9f47527dbd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:10.895731 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d12decc-e5ae-4069-a7a9-8f9f47527dbd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:10.896153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d12decc-e5ae-4069-a7a9-8f9f47527dbd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:11.025682 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9d12decc-e5ae-4069-a7a9-8f9f47527dbd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:11.034300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9d12decc-e5ae-4069-a7a9-8f9f47527dbd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:11.035805 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9d12decc-e5ae-4069-a7a9-8f9f47527dbd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:11.036905 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9d12decc-e5ae-4069-a7a9-8f9f47527dbd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1406 microversion: 2.20 time: 0.154786 Aug 08 02:34:11.037454 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 424/864] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:34:10 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:34:12.059164 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-77675017-fde8-49e6-8a43-a746704c89e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:12.059767 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-77675017-fde8-49e6-8a43-a746704c89e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:12.066431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-77675017-fde8-49e6-8a43-a746704c89e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:12.066908 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-77675017-fde8-49e6-8a43-a746704c89e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:12.067340 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-77675017-fde8-49e6-8a43-a746704c89e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:12.068018 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-77675017-fde8-49e6-8a43-a746704c89e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:12.068464 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-77675017-fde8-49e6-8a43-a746704c89e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:12.068887 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-77675017-fde8-49e6-8a43-a746704c89e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:12.200199 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-77675017-fde8-49e6-8a43-a746704c89e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:12.208213 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-77675017-fde8-49e6-8a43-a746704c89e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:12.209714 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-77675017-fde8-49e6-8a43-a746704c89e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:12.210835 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-77675017-fde8-49e6-8a43-a746704c89e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1406 microversion: 2.20 time: 0.155598 Aug 08 02:34:12.211383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 441/865] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:34:12 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:34:12.566038 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-9bca40ca-be5f-4387-b02b-8b3320ba0729 req-5020204a-dbc6-4e70-88d6-63d1be3160da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614b1928-9870-453b-8bf7-7b21f36ed2be", "name": "network-vif-plugged", "status": "completed", "tag": "2d321e72-03cd-4396-9683-df053c6107d1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:12.576279 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9bca40ca-be5f-4387-b02b-8b3320ba0729 req-5020204a-dbc6-4e70-88d6-63d1be3160da service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:12.576761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9bca40ca-be5f-4387-b02b-8b3320ba0729 req-5020204a-dbc6-4e70-88d6-63d1be3160da service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:12.577201 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9bca40ca-be5f-4387-b02b-8b3320ba0729 req-5020204a-dbc6-4e70-88d6-63d1be3160da service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:12.588646 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-9bca40ca-be5f-4387-b02b-8b3320ba0729 req-5020204a-dbc6-4e70-88d6-63d1be3160da service nova] Creating event network-vif-plugged:2d321e72-03cd-4396-9683-df053c6107d1 for instance 614b1928-9870-453b-8bf7-7b21f36ed2be on hv-cinder-73306 Aug 08 02:34:12.593357 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-9bca40ca-be5f-4387-b02b-8b3320ba0729 req-5020204a-dbc6-4e70-88d6-63d1be3160da service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031598 Aug 08 02:34:12.593939 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 425/866] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:13.233788 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-410ebe83-b469-492e-9f58-d54cdbef9cb2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:13.234439 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-410ebe83-b469-492e-9f58-d54cdbef9cb2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:13.243006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-410ebe83-b469-492e-9f58-d54cdbef9cb2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:13.243478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-410ebe83-b469-492e-9f58-d54cdbef9cb2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:13.243904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-410ebe83-b469-492e-9f58-d54cdbef9cb2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:13.244581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-410ebe83-b469-492e-9f58-d54cdbef9cb2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:13.245028 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-410ebe83-b469-492e-9f58-d54cdbef9cb2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:13.245444 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-410ebe83-b469-492e-9f58-d54cdbef9cb2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:13.374719 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-410ebe83-b469-492e-9f58-d54cdbef9cb2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:13.383242 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-410ebe83-b469-492e-9f58-d54cdbef9cb2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:13.384747 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-410ebe83-b469-492e-9f58-d54cdbef9cb2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:13.385837 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-410ebe83-b469-492e-9f58-d54cdbef9cb2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1406 microversion: 2.20 time: 0.155933 Aug 08 02:34:13.386461 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 442/867] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:34:13 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:34:14.405826 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:14.406603 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:14.410608 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b95a00b7-417a-437b-aed7-ede7244b8e5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:14.411305 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b95a00b7-417a-437b-aed7-ede7244b8e5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:14.419049 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b95a00b7-417a-437b-aed7-ede7244b8e5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:14.419633 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b95a00b7-417a-437b-aed7-ede7244b8e5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:14.420073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b95a00b7-417a-437b-aed7-ede7244b8e5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:14.420775 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b95a00b7-417a-437b-aed7-ede7244b8e5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:14.421225 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b95a00b7-417a-437b-aed7-ede7244b8e5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:14.421643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b95a00b7-417a-437b-aed7-ede7244b8e5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:14.555776 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b95a00b7-417a-437b-aed7-ede7244b8e5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:14.563656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b95a00b7-417a-437b-aed7-ede7244b8e5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:14.565877 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b95a00b7-417a-437b-aed7-ede7244b8e5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:14.566988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b95a00b7-417a-437b-aed7-ede7244b8e5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1406 microversion: 2.20 time: 0.162630 Aug 08 02:34:14.567533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 426/868] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:34:14 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:34:15.584191 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d3c48bc5-43f4-45f6-a75f-261e52dca5ee tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1794644085"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:15.584704 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d3c48bc5-43f4-45f6-a75f-261e52dca5ee tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:15.586537 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=6 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:15.588798 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-89367b89-c991-4e9d-8b65-2bf4808c1830 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:15.589667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-89367b89-c991-4e9d-8b65-2bf4808c1830 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:15.592455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d3c48bc5-43f4-45f6-a75f-261e52dca5ee tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:15.592930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d3c48bc5-43f4-45f6-a75f-261e52dca5ee tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:15.593355 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d3c48bc5-43f4-45f6-a75f-261e52dca5ee tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:15.594036 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d3c48bc5-43f4-45f6-a75f-261e52dca5ee tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:15.594511 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d3c48bc5-43f4-45f6-a75f-261e52dca5ee tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:15.594931 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d3c48bc5-43f4-45f6-a75f-261e52dca5ee tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:15.596878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89367b89-c991-4e9d-8b65-2bf4808c1830 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:15.597350 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89367b89-c991-4e9d-8b65-2bf4808c1830 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:15.597809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89367b89-c991-4e9d-8b65-2bf4808c1830 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:15.598519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89367b89-c991-4e9d-8b65-2bf4808c1830 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:15.598971 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89367b89-c991-4e9d-8b65-2bf4808c1830 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:15.599543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89367b89-c991-4e9d-8b65-2bf4808c1830 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:15.726417 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.network.security_group_api [None req-d3c48bc5-43f4-45f6-a75f-261e52dca5ee tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Removing security group 86e2b708-c853-4777-baf0-eff8726eaf39 from port 0cf66020-aef8-4e07-8464-3cd2cc846c95 Aug 08 02:34:15.734068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-89367b89-c991-4e9d-8b65-2bf4808c1830 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:15.742275 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-89367b89-c991-4e9d-8b65-2bf4808c1830 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:15.743799 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-89367b89-c991-4e9d-8b65-2bf4808c1830 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:15.744946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-89367b89-c991-4e9d-8b65-2bf4808c1830 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1598 microversion: 2.20 time: 0.160082 Aug 08 02:34:15.745598 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 427/869] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:34:15 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:34:15.767193 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c083f591-065e-4e37-ae25-a27b2878d56b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:15.768232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c083f591-065e-4e37-ae25-a27b2878d56b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:15.774037 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c083f591-065e-4e37-ae25-a27b2878d56b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:15.774668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c083f591-065e-4e37-ae25-a27b2878d56b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:15.775107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c083f591-065e-4e37-ae25-a27b2878d56b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:15.775802 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c083f591-065e-4e37-ae25-a27b2878d56b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:15.776252 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c083f591-065e-4e37-ae25-a27b2878d56b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:15.776673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c083f591-065e-4e37-ae25-a27b2878d56b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:15.855580 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c083f591-065e-4e37-ae25-a27b2878d56b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092055 Aug 08 02:34:15.856317 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 428/870] 10.222.0.39 () {60 vars in 1316 bytes} [Mon Aug 8 02:34:15 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 02:34:16.033728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d3c48bc5-43f4-45f6-a75f-261e52dca5ee tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "POST /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/action" status: 202 len: 0 microversion: 2.1 time: 0.453847 Aug 08 02:34:16.037491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 443/871] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:34:15 2022] POST /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:34:16.043024 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-6967f871-910f-4a9f-b647-2745edf9773b req-e8607b06-720a-4a9c-b37e-bd5c973aabb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80280a99-0ab1-4981-96ff-9bebd5488772", "tag": "0cf66020-aef8-4e07-8464-3cd2cc846c95"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:16.052874 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6967f871-910f-4a9f-b647-2745edf9773b req-e8607b06-720a-4a9c-b37e-bd5c973aabb4 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:16.053355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6967f871-910f-4a9f-b647-2745edf9773b req-e8607b06-720a-4a9c-b37e-bd5c973aabb4 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:16.053790 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6967f871-910f-4a9f-b647-2745edf9773b req-e8607b06-720a-4a9c-b37e-bd5c973aabb4 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:16.086930 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-6967f871-910f-4a9f-b647-2745edf9773b req-e8607b06-720a-4a9c-b37e-bd5c973aabb4 service nova] Creating event network-changed:0cf66020-aef8-4e07-8464-3cd2cc846c95 for instance 80280a99-0ab1-4981-96ff-9bebd5488772 on hv-cinder-73306 Aug 08 02:34:16.097417 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-6967f871-910f-4a9f-b647-2745edf9773b req-e8607b06-720a-4a9c-b37e-bd5c973aabb4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057814 Aug 08 02:34:16.098169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 429/872] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:17.410036 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-9f5f4261-cf87-4c5e-bd4d-887886d11dcb req-90914678-c863-46e5-b3e1-51d0cee1970b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614b1928-9870-453b-8bf7-7b21f36ed2be", "tag": "2d321e72-03cd-4396-9683-df053c6107d1"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:17.420749 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-9f5f4261-cf87-4c5e-bd4d-887886d11dcb req-90914678-c863-46e5-b3e1-51d0cee1970b service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:17.421540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-9f5f4261-cf87-4c5e-bd4d-887886d11dcb req-90914678-c863-46e5-b3e1-51d0cee1970b service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:17.422030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-9f5f4261-cf87-4c5e-bd4d-887886d11dcb req-90914678-c863-46e5-b3e1-51d0cee1970b service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:17.440886 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-9f5f4261-cf87-4c5e-bd4d-887886d11dcb req-90914678-c863-46e5-b3e1-51d0cee1970b service nova] Creating event network-changed:2d321e72-03cd-4396-9683-df053c6107d1 for instance 614b1928-9870-453b-8bf7-7b21f36ed2be on hv-cinder-73306 Aug 08 02:34:17.448682 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-9f5f4261-cf87-4c5e-bd4d-887886d11dcb req-90914678-c863-46e5-b3e1-51d0cee1970b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043581 Aug 08 02:34:17.449792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 444/873] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:17.892184 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0aeac5f8-5cc1-4d0b-b1a1-8ee825915a99 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:17.892900 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0aeac5f8-5cc1-4d0b-b1a1-8ee825915a99 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:17.900139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0aeac5f8-5cc1-4d0b-b1a1-8ee825915a99 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:17.900711 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0aeac5f8-5cc1-4d0b-b1a1-8ee825915a99 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:17.901213 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0aeac5f8-5cc1-4d0b-b1a1-8ee825915a99 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:17.901991 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0aeac5f8-5cc1-4d0b-b1a1-8ee825915a99 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:17.902564 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0aeac5f8-5cc1-4d0b-b1a1-8ee825915a99 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:17.903057 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0aeac5f8-5cc1-4d0b-b1a1-8ee825915a99 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:17.994565 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-0aeac5f8-5cc1-4d0b-b1a1-8ee825915a99 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lazy-loading 'services' on Instance uuid 80280a99-0ab1-4981-96ff-9bebd5488772 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:34:18.083135 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0aeac5f8-5cc1-4d0b-b1a1-8ee825915a99 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "DELETE /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/os-volume_attachments/55f3458c-147f-4af4-81e4-a58ffc1ac0db" status: 202 len: 0 microversion: 2.1 time: 0.191966 Aug 08 02:34:18.083769 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 430/874] 10.222.0.39 () {58 vars in 1416 bytes} [Mon Aug 8 02:34:17 2022] DELETE /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/os-volume_attachments/55f3458c-147f-4af4-81e4-a58ffc1ac0db => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:34:18.094057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9f60fcbf-4787-4a7a-8a4e-0e652376493e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:18.097435 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9f60fcbf-4787-4a7a-8a4e-0e652376493e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:18.108354 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9f60fcbf-4787-4a7a-8a4e-0e652376493e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:18.111127 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9f60fcbf-4787-4a7a-8a4e-0e652376493e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:18.112250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9f60fcbf-4787-4a7a-8a4e-0e652376493e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:18.114661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9f60fcbf-4787-4a7a-8a4e-0e652376493e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:18.115261 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9f60fcbf-4787-4a7a-8a4e-0e652376493e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:18.115964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9f60fcbf-4787-4a7a-8a4e-0e652376493e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:18.136523 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:18.147839 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9f60fcbf-4787-4a7a-8a4e-0e652376493e tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059324 Aug 08 02:34:18.148415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 445/875] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:34:18 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:19.161383 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e3d4d49c-5329-413c-a4fc-33afcb3b5a8d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:19.163718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e3d4d49c-5329-413c-a4fc-33afcb3b5a8d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:19.169836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3d4d49c-5329-413c-a4fc-33afcb3b5a8d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:19.171127 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3d4d49c-5329-413c-a4fc-33afcb3b5a8d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:19.171676 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3d4d49c-5329-413c-a4fc-33afcb3b5a8d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:19.172481 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3d4d49c-5329-413c-a4fc-33afcb3b5a8d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:19.172941 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3d4d49c-5329-413c-a4fc-33afcb3b5a8d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:19.173394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3d4d49c-5329-413c-a4fc-33afcb3b5a8d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:19.177946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:19.205954 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e3d4d49c-5329-413c-a4fc-33afcb3b5a8d tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049417 Aug 08 02:34:19.206533 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 431/876] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:34:19 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:34:19.217769 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a9259e63-dc71-41eb-9971-3fcef00eb3f9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:19.218312 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a9259e63-dc71-41eb-9971-3fcef00eb3f9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:19.225733 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9259e63-dc71-41eb-9971-3fcef00eb3f9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:19.226208 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9259e63-dc71-41eb-9971-3fcef00eb3f9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:19.226670 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9259e63-dc71-41eb-9971-3fcef00eb3f9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:19.227348 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9259e63-dc71-41eb-9971-3fcef00eb3f9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:19.227798 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9259e63-dc71-41eb-9971-3fcef00eb3f9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:19.228213 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9259e63-dc71-41eb-9971-3fcef00eb3f9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:19.301186 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-a9259e63-dc71-41eb-9971-3fcef00eb3f9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] HTTP exception thrown: Instance 80280a99-0ab1-4981-96ff-9bebd5488772 is not attached to volume 55f3458c-147f-4af4-81e4-a58ffc1ac0db Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a9259e63-dc71-41eb-9971-3fcef00eb3f9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Request method failure captured: Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: DELETE /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/os-volume_attachments/55f3458c-147f-4af4-81e4-a58ffc1ac0db HTTP/1.1 Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HVLcp2-Y-HVecEof1K1ik5v5HM7ZF-6UuA89JhdLFRAREHbh3t5NC7DO_lAbGD13lDGt3L9ls2IXEYejBbZ6Knnlkr--MAnxRI0YYUze9s996DHhqSm9EZUHxZpcXOsLsLl-YYLWd2PXHlnsKJOwSFtMnfMAdAars0ndlXgs8X7Vo0 Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: ef9eec76edd24a338dc9fdd966fceacd Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-TestMinimumBasicScenario-1884493593 Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:34:19.303603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:34:19.305288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ef9eec76edd24a338dc9fdd966fceacd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ef9eec76edd24a338dc9fdd966fceacd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ef9eec76edd24a338dc9fdd966fceacd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ef9eec76edd24a338dc9fdd966fceacd"}]}] Aug 08 02:34:19.305288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-TestMinimumBasicScenario-1884493593 Aug 08 02:34:19.305288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: ef9eec76edd24a338dc9fdd966fceacd Aug 08 02:34:19.305288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1884493593 Aug 08 02:34:19.305288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-TestMinimumBasicScenario-1884493593-project Aug 08 02:34:19.305288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:34:19.305288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:34:19.305288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 714f7c450ca945d4b2e149153ccfcdce Aug 08 02:34:19.305288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-TestMinimumBasicScenario-1884493593-project Aug 08 02:34:19.305288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:34:19.305288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 80280a99-0ab1-4981-96ff-9bebd5488772 is not attached to volume 55f3458c-147f-4af4-81e4-a58ffc1ac0db Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'server_id': '80280a99-0ab1-4981-96ff-9bebd5488772', 'id': '55f3458c-147f-4af4-81e4-a58ffc1ac0db'} Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 55f3458c-147f-4af4-81e4-a58ffc1ac0db. Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:34:19.306271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80280a99-0ab1-4981-96ff-9bebd5488772 is not attached to volume 55f3458c-147f-4af4-81e4-a58ffc1ac0db Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80280a99-0ab1-4981-96ff-9bebd5488772 is not attached to volume 55f3458c-147f-4af4-81e4-a58ffc1ac0db Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:19.307966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a9259e63-dc71-41eb-9971-3fcef00eb3f9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Returning 404 to user: Instance 80280a99-0ab1-4981-96ff-9bebd5488772 is not attached to volume 55f3458c-147f-4af4-81e4-a58ffc1ac0db {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:34:19.309302 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a9259e63-dc71-41eb-9971-3fcef00eb3f9 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "DELETE /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/os-volume_attachments/55f3458c-147f-4af4-81e4-a58ffc1ac0db" status: 404 len: 154 microversion: 2.1 time: 0.091329 Aug 08 02:34:19.309302 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 446/877] 10.222.0.39 () {58 vars in 1416 bytes} [Mon Aug 8 02:34:19 2022] DELETE /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772/os-volume_attachments/55f3458c-147f-4af4-81e4-a58ffc1ac0db => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:34:19.474120 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-17079aea-a6f2-4c62-b815-2ca10725a623 req-36b62263-d1b3-4d1a-8b0a-b928b514925b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80280a99-0ab1-4981-96ff-9bebd5488772", "tag": "0cf66020-aef8-4e07-8464-3cd2cc846c95"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:19.483589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-17079aea-a6f2-4c62-b815-2ca10725a623 req-36b62263-d1b3-4d1a-8b0a-b928b514925b service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:19.484063 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-17079aea-a6f2-4c62-b815-2ca10725a623 req-36b62263-d1b3-4d1a-8b0a-b928b514925b service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:19.484492 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-17079aea-a6f2-4c62-b815-2ca10725a623 req-36b62263-d1b3-4d1a-8b0a-b928b514925b service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:19.496401 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-17079aea-a6f2-4c62-b815-2ca10725a623 req-36b62263-d1b3-4d1a-8b0a-b928b514925b service nova] Creating event network-changed:0cf66020-aef8-4e07-8464-3cd2cc846c95 for instance 80280a99-0ab1-4981-96ff-9bebd5488772 on hv-cinder-73306 Aug 08 02:34:19.501783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-17079aea-a6f2-4c62-b815-2ca10725a623 req-36b62263-d1b3-4d1a-8b0a-b928b514925b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031862 Aug 08 02:34:19.502768 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 432/878] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:20.442568 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0152c95b-dc29-4208-a950-4ede72ef4c9f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:20.443096 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0152c95b-dc29-4208-a950-4ede72ef4c9f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:20.449549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0152c95b-dc29-4208-a950-4ede72ef4c9f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:20.450023 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0152c95b-dc29-4208-a950-4ede72ef4c9f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:20.450478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0152c95b-dc29-4208-a950-4ede72ef4c9f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:20.451159 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0152c95b-dc29-4208-a950-4ede72ef4c9f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:20.451604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0152c95b-dc29-4208-a950-4ede72ef4c9f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:20.452016 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0152c95b-dc29-4208-a950-4ede72ef4c9f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:20.476908 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0152c95b-dc29-4208-a950-4ede72ef4c9f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:34:20.549662 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0152c95b-dc29-4208-a950-4ede72ef4c9f tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "DELETE /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 204 len: 0 microversion: 2.1 time: 0.110957 Aug 08 02:34:20.550788 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 447/879] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:34:20 2022] DELETE /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 02:34:20.559481 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8b8cbda3-c178-496e-9737-ff929cedfb0a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:20.560177 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8b8cbda3-c178-496e-9737-ff929cedfb0a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:20.566955 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b8cbda3-c178-496e-9737-ff929cedfb0a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:20.567429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b8cbda3-c178-496e-9737-ff929cedfb0a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:20.567856 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b8cbda3-c178-496e-9737-ff929cedfb0a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:20.568528 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b8cbda3-c178-496e-9737-ff929cedfb0a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:20.568969 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b8cbda3-c178-496e-9737-ff929cedfb0a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:20.569388 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b8cbda3-c178-496e-9737-ff929cedfb0a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:20.699622 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b8cbda3-c178-496e-9737-ff929cedfb0a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:20.707645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8b8cbda3-c178-496e-9737-ff929cedfb0a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1552 microversion: 2.1 time: 0.152375 Aug 08 02:34:20.708217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 433/880] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:20 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:21.729422 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-262ded65-1ea8-427c-aa75-c5952c6c27cb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:21.730039 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-262ded65-1ea8-427c-aa75-c5952c6c27cb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:21.736383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-262ded65-1ea8-427c-aa75-c5952c6c27cb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:21.736855 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-262ded65-1ea8-427c-aa75-c5952c6c27cb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:21.737889 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-262ded65-1ea8-427c-aa75-c5952c6c27cb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:21.738587 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-262ded65-1ea8-427c-aa75-c5952c6c27cb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:21.739031 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-262ded65-1ea8-427c-aa75-c5952c6c27cb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:21.739445 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-262ded65-1ea8-427c-aa75-c5952c6c27cb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:21.865407 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-262ded65-1ea8-427c-aa75-c5952c6c27cb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:21.872770 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-262ded65-1ea8-427c-aa75-c5952c6c27cb tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1552 microversion: 2.1 time: 0.147670 Aug 08 02:34:21.873330 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 448/881] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:21 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:22.893198 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f71a79b2-c6b5-4961-b829-4f91500d12a8 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:22.893818 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f71a79b2-c6b5-4961-b829-4f91500d12a8 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:22.900306 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f71a79b2-c6b5-4961-b829-4f91500d12a8 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:22.900791 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f71a79b2-c6b5-4961-b829-4f91500d12a8 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:22.901228 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f71a79b2-c6b5-4961-b829-4f91500d12a8 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:22.901921 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f71a79b2-c6b5-4961-b829-4f91500d12a8 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:22.902409 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f71a79b2-c6b5-4961-b829-4f91500d12a8 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:22.902839 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f71a79b2-c6b5-4961-b829-4f91500d12a8 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:22.946415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-74dc3fde-e03a-4f68-8150-2953201e9c15 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:22.946972 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-74dc3fde-e03a-4f68-8150-2953201e9c15 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:22.953373 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-74dc3fde-e03a-4f68-8150-2953201e9c15 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:22.953928 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-74dc3fde-e03a-4f68-8150-2953201e9c15 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:22.954492 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-74dc3fde-e03a-4f68-8150-2953201e9c15 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:22.955255 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-74dc3fde-e03a-4f68-8150-2953201e9c15 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:22.955775 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-74dc3fde-e03a-4f68-8150-2953201e9c15 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:22.956569 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-74dc3fde-e03a-4f68-8150-2953201e9c15 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:22.979242 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-74dc3fde-e03a-4f68-8150-2953201e9c15 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/ips" status: 200 len: 149 microversion: 2.1 time: 0.036790 Aug 08 02:34:22.980215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 449/882] 10.222.0.39 () {58 vars in 1248 bytes} [Mon Aug 8 02:34:22 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:34:23.037443 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f71a79b2-c6b5-4961-b829-4f91500d12a8 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '714f7c450ca945d4b2e149153ccfcdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef9eec76edd24a338dc9fdd966fceacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:23.045585 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f71a79b2-c6b5-4961-b829-4f91500d12a8 tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 200 len: 1552 microversion: 2.1 time: 0.156187 Aug 08 02:34:23.046578 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 434/883] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:22 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:23.493922 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-7989fe57-1ee9-47b2-a8be-337add8fcb92 req-533a148d-dbfd-42bc-a15a-cf5d445f34e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80280a99-0ab1-4981-96ff-9bebd5488772", "name": "network-vif-deleted", "tag": "0cf66020-aef8-4e07-8464-3cd2cc846c95"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:23.522557 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-7989fe57-1ee9-47b2-a8be-337add8fcb92 req-533a148d-dbfd-42bc-a15a-cf5d445f34e0 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:23.523052 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-7989fe57-1ee9-47b2-a8be-337add8fcb92 req-533a148d-dbfd-42bc-a15a-cf5d445f34e0 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:23.523686 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-7989fe57-1ee9-47b2-a8be-337add8fcb92 req-533a148d-dbfd-42bc-a15a-cf5d445f34e0 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:23.539281 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-7989fe57-1ee9-47b2-a8be-337add8fcb92 req-533a148d-dbfd-42bc-a15a-cf5d445f34e0 service nova] Creating event network-vif-deleted:0cf66020-aef8-4e07-8464-3cd2cc846c95 for instance 80280a99-0ab1-4981-96ff-9bebd5488772 on hv-cinder-73306 Aug 08 02:34:23.544026 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-7989fe57-1ee9-47b2-a8be-337add8fcb92 req-533a148d-dbfd-42bc-a15a-cf5d445f34e0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053759 Aug 08 02:34:23.544611 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 450/884] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:24.067235 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e7a5f40e-39f1-4b21-a399-e49cd96c9d1a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:24.067777 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e7a5f40e-39f1-4b21-a399-e49cd96c9d1a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] [instance: 80280a99-0ab1-4981-96ff-9bebd5488772] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:24.074045 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e7a5f40e-39f1-4b21-a399-e49cd96c9d1a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:24.074588 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e7a5f40e-39f1-4b21-a399-e49cd96c9d1a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:24.075008 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e7a5f40e-39f1-4b21-a399-e49cd96c9d1a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:24.075713 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e7a5f40e-39f1-4b21-a399-e49cd96c9d1a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:24.076163 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e7a5f40e-39f1-4b21-a399-e49cd96c9d1a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:24.076665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e7a5f40e-39f1-4b21-a399-e49cd96c9d1a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:24.089965 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-e7a5f40e-39f1-4b21-a399-e49cd96c9d1a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] HTTP exception thrown: Instance 80280a99-0ab1-4981-96ff-9bebd5488772 could not be found. Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e7a5f40e-39f1-4b21-a399-e49cd96c9d1a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Request method failure captured: Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 HTTP/1.1 Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HVLcp2-Y-HVecEof1K1ik5v5HM7ZF-6UuA89JhdLFRAREHbh3t5NC7DO_lAbGD13lDGt3L9ls2IXEYejBbZ6Knnlkr--MAnxRI0YYUze9s996DHhqSm9EZUHxZpcXOsLsLl-YYLWd2PXHlnsKJOwSFtMnfMAdAars0ndlXgs8X7Vo0 Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: ef9eec76edd24a338dc9fdd966fceacd Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-TestMinimumBasicScenario-1884493593 Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:34:24.091665 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:34:24.093187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ef9eec76edd24a338dc9fdd966fceacd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ef9eec76edd24a338dc9fdd966fceacd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ef9eec76edd24a338dc9fdd966fceacd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ef9eec76edd24a338dc9fdd966fceacd"}]}] Aug 08 02:34:24.093187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-TestMinimumBasicScenario-1884493593 Aug 08 02:34:24.093187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: ef9eec76edd24a338dc9fdd966fceacd Aug 08 02:34:24.093187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1884493593 Aug 08 02:34:24.093187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-TestMinimumBasicScenario-1884493593-project Aug 08 02:34:24.093187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:34:24.093187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:34:24.093187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 714f7c450ca945d4b2e149153ccfcdce Aug 08 02:34:24.093187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-TestMinimumBasicScenario-1884493593-project Aug 08 02:34:24.093187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:34:24.093187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 80280a99-0ab1-4981-96ff-9bebd5488772 could not be found. Aug 08 02:34:24.093187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '80280a99-0ab1-4981-96ff-9bebd5488772'} Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80280a99-0ab1-4981-96ff-9bebd5488772 could not be found. Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:34:24.094142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80280a99-0ab1-4981-96ff-9bebd5488772 could not be found. Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80280a99-0ab1-4981-96ff-9bebd5488772 could not be found. Aug 08 02:34:24.095742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:34:24.097797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e7a5f40e-39f1-4b21-a399-e49cd96c9d1a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Returning 404 to user: Instance 80280a99-0ab1-4981-96ff-9bebd5488772 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:34:24.097797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e7a5f40e-39f1-4b21-a399-e49cd96c9d1a tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772" status: 404 len: 111 microversion: 2.1 time: 0.030068 Aug 08 02:34:24.097797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 435/885] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:24 2022] GET /compute/v2.1/servers/80280a99-0ab1-4981-96ff-9bebd5488772 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:34:24.103136 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ac6ea97a-e9d6-4916-a7c2-a25613cd857b tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] Calling method '.version_select at 0x7f329506ed30>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:24.121480 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ac6ea97a-e9d6-4916-a7c2-a25613cd857b tempest-TestMinimumBasicScenario-1884493593 tempest-TestMinimumBasicScenario-1884493593-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-287893335" status: 202 len: 0 microversion: 2.1 time: 0.022936 Aug 08 02:34:24.122011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 451/886] 10.222.0.39 () {58 vars in 1269 bytes} [Mon Aug 8 02:34:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-287893335 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:34:24.338919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f98beeff-d8f4-445f-be93-ff54c093af7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c64619f5-3e32-465f-a99b-ebb48cb1d173"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:24.341382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f98beeff-d8f4-445f-be93-ff54c093af7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:24.348027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f98beeff-d8f4-445f-be93-ff54c093af7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:24.348508 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f98beeff-d8f4-445f-be93-ff54c093af7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:24.348943 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f98beeff-d8f4-445f-be93-ff54c093af7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:24.349643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f98beeff-d8f4-445f-be93-ff54c093af7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:24.350095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f98beeff-d8f4-445f-be93-ff54c093af7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:24.350548 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f98beeff-d8f4-445f-be93-ff54c093af7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:24.621926 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f98beeff-d8f4-445f-be93-ff54c093af7d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286759 Aug 08 02:34:24.628596 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 436/887] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:34:24 2022] POST /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:32.199566 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b640e1a3-973f-4fac-8bfb-c4bafe7b49a1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c64619f5-3e32-465f-a99b-ebb48cb1d173"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:32.202450 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b640e1a3-973f-4fac-8bfb-c4bafe7b49a1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:32.211341 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b640e1a3-973f-4fac-8bfb-c4bafe7b49a1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:32.211927 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b640e1a3-973f-4fac-8bfb-c4bafe7b49a1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:32.212406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b640e1a3-973f-4fac-8bfb-c4bafe7b49a1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:32.213117 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b640e1a3-973f-4fac-8bfb-c4bafe7b49a1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:32.213562 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b640e1a3-973f-4fac-8bfb-c4bafe7b49a1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:32.214089 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b640e1a3-973f-4fac-8bfb-c4bafe7b49a1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:32.299685 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-b640e1a3-973f-4fac-8bfb-c4bafe7b49a1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Invalid volume: volume c64619f5-3e32-465f-a99b-ebb48cb1d173 is already attached to instances: 68078741-87cd-4d1a-a760-fbc0dd0f29ef Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b640e1a3-973f-4fac-8bfb-c4bafe7b49a1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: POST /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-volume_attachments HTTP/1.1 Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 74 Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:34:32.301529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:34:32.302965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:34:32.302965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:34:32.302965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:34:32.302965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:34:32.302965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:34:32.302965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:34:32.302965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:34:32.302965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:34:32.302965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:34:32.302965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Aug 08 02:34:32.302965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {"volumeAttachment": {"volumeId": "c64619f5-3e32-465f-a99b-ebb48cb1d173"}} Aug 08 02:34:32.302965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Invalid volume: volume c64619f5-3e32-465f-a99b-ebb48cb1d173 is already attached to instances: 68078741-87cd-4d1a-a760-fbc0dd0f29ef Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'server_id': '68078741-87cd-4d1a-a760-fbc0dd0f29ef', 'body': {'volumeAttachment': {'volumeId': 'c64619f5-3e32-465f-a99b-ebb48cb1d173'}}} Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c64619f5-3e32-465f-a99b-ebb48cb1d173 is already attached to instances: 68078741-87cd-4d1a-a760-fbc0dd0f29ef Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:32.303728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c64619f5-3e32-465f-a99b-ebb48cb1d173 is already attached to instances: 68078741-87cd-4d1a-a760-fbc0dd0f29ef Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:34:32.304830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:34:32.306056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:34:32.306056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:34:32.306056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:34:32.306056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c64619f5-3e32-465f-a99b-ebb48cb1d173 is already attached to instances: 68078741-87cd-4d1a-a760-fbc0dd0f29ef Aug 08 02:34:32.306056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:32.306056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b640e1a3-973f-4fac-8bfb-c4bafe7b49a1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 400 to user: Invalid volume: volume c64619f5-3e32-465f-a99b-ebb48cb1d173 is already attached to instances: 68078741-87cd-4d1a-a760-fbc0dd0f29ef {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:34:32.306056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b640e1a3-973f-4fac-8bfb-c4bafe7b49a1 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107532 Aug 08 02:34:32.306056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 452/888] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:34:32 2022] POST /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:34:32.375371 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-face36f3-7f09-4f91-88f7-45e439d67382 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:32.376087 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-face36f3-7f09-4f91-88f7-45e439d67382 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:32.383501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-face36f3-7f09-4f91-88f7-45e439d67382 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:32.384092 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-face36f3-7f09-4f91-88f7-45e439d67382 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:32.384595 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-face36f3-7f09-4f91-88f7-45e439d67382 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:32.385413 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-face36f3-7f09-4f91-88f7-45e439d67382 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:32.385933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-face36f3-7f09-4f91-88f7-45e439d67382 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:32.386458 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-face36f3-7f09-4f91-88f7-45e439d67382 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:32.472216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-face36f3-7f09-4f91-88f7-45e439d67382 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lazy-loading 'services' on Instance uuid 68078741-87cd-4d1a-a760-fbc0dd0f29ef {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:34:32.542616 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-face36f3-7f09-4f91-88f7-45e439d67382 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-volume_attachments/c64619f5-3e32-465f-a99b-ebb48cb1d173" status: 202 len: 0 microversion: 2.1 time: 0.172147 Aug 08 02:34:32.543591 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 437/889] 10.222.0.39 () {58 vars in 1416 bytes} [Mon Aug 8 02:34:32 2022] DELETE /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-volume_attachments/c64619f5-3e32-465f-a99b-ebb48cb1d173 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:34:32.553352 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-92f1eaad-ca78-4b92-85e5-f6c71009ad44 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:32.555620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-92f1eaad-ca78-4b92-85e5-f6c71009ad44 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:32.562655 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92f1eaad-ca78-4b92-85e5-f6c71009ad44 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:32.563860 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92f1eaad-ca78-4b92-85e5-f6c71009ad44 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:32.565142 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92f1eaad-ca78-4b92-85e5-f6c71009ad44 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:32.567113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92f1eaad-ca78-4b92-85e5-f6c71009ad44 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:32.567579 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92f1eaad-ca78-4b92-85e5-f6c71009ad44 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:32.568006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92f1eaad-ca78-4b92-85e5-f6c71009ad44 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:32.598791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-92f1eaad-ca78-4b92-85e5-f6c71009ad44 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049997 Aug 08 02:34:32.599262 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 453/890] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:34:32 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:33.611618 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b364afc9-40a8-48f6-a852-87bae84e23bc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:33.613975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b364afc9-40a8-48f6-a852-87bae84e23bc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:33.620543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b364afc9-40a8-48f6-a852-87bae84e23bc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:33.621018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b364afc9-40a8-48f6-a852-87bae84e23bc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:33.621445 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b364afc9-40a8-48f6-a852-87bae84e23bc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:33.622124 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b364afc9-40a8-48f6-a852-87bae84e23bc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:33.622593 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b364afc9-40a8-48f6-a852-87bae84e23bc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:33.623010 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b364afc9-40a8-48f6-a852-87bae84e23bc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:33.652159 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b364afc9-40a8-48f6-a852-87bae84e23bc tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044779 Aug 08 02:34:33.652692 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 438/891] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:34:33 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:34:33.712821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2b0579aa-5acb-4dac-8ac2-791219d6f970 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:33.713296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2b0579aa-5acb-4dac-8ac2-791219d6f970 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:33.719678 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b0579aa-5acb-4dac-8ac2-791219d6f970 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:33.720157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b0579aa-5acb-4dac-8ac2-791219d6f970 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:33.720585 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b0579aa-5acb-4dac-8ac2-791219d6f970 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:33.721263 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b0579aa-5acb-4dac-8ac2-791219d6f970 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:33.721713 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b0579aa-5acb-4dac-8ac2-791219d6f970 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:33.722130 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b0579aa-5acb-4dac-8ac2-791219d6f970 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:33.746540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2b0579aa-5acb-4dac-8ac2-791219d6f970 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:34:33.813476 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:33.821765 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2b0579aa-5acb-4dac-8ac2-791219d6f970 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 204 len: 0 microversion: 2.1 time: 0.112690 Aug 08 02:34:33.822418 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 454/892] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:34:33 2022] DELETE /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 02:34:33.831657 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e27ac336-7372-4c39-97ef-2b133f23d690 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:33.832271 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e27ac336-7372-4c39-97ef-2b133f23d690 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:33.838091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e27ac336-7372-4c39-97ef-2b133f23d690 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:33.838611 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e27ac336-7372-4c39-97ef-2b133f23d690 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:33.839046 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e27ac336-7372-4c39-97ef-2b133f23d690 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:33.839729 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e27ac336-7372-4c39-97ef-2b133f23d690 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:33.840183 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e27ac336-7372-4c39-97ef-2b133f23d690 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:33.840604 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e27ac336-7372-4c39-97ef-2b133f23d690 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:33.969465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e27ac336-7372-4c39-97ef-2b133f23d690 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:33.976916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e27ac336-7372-4c39-97ef-2b133f23d690 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1679 microversion: 2.1 time: 0.149836 Aug 08 02:34:33.977478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 439/893] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:33 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:34.999129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c57892cc-44c3-4bc7-a854-f8602d41682a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:34.999821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c57892cc-44c3-4bc7-a854-f8602d41682a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:35.006622 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c57892cc-44c3-4bc7-a854-f8602d41682a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:35.007104 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c57892cc-44c3-4bc7-a854-f8602d41682a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:35.007540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c57892cc-44c3-4bc7-a854-f8602d41682a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:35.008219 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c57892cc-44c3-4bc7-a854-f8602d41682a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:35.008667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c57892cc-44c3-4bc7-a854-f8602d41682a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:35.009086 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c57892cc-44c3-4bc7-a854-f8602d41682a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:35.137601 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c57892cc-44c3-4bc7-a854-f8602d41682a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:35.145958 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c57892cc-44c3-4bc7-a854-f8602d41682a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1679 microversion: 2.1 time: 0.150996 Aug 08 02:34:35.146558 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 455/894] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:34 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:36.167022 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6c6b62e3-bcde-498d-94f8-1babd5aca751 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:36.167627 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6c6b62e3-bcde-498d-94f8-1babd5aca751 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:36.170160 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=38 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:36.176153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c6b62e3-bcde-498d-94f8-1babd5aca751 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:36.176634 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c6b62e3-bcde-498d-94f8-1babd5aca751 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:36.177068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c6b62e3-bcde-498d-94f8-1babd5aca751 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:36.177756 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c6b62e3-bcde-498d-94f8-1babd5aca751 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:36.178204 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c6b62e3-bcde-498d-94f8-1babd5aca751 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:36.178698 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c6b62e3-bcde-498d-94f8-1babd5aca751 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:36.309596 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6c6b62e3-bcde-498d-94f8-1babd5aca751 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:36.317653 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6c6b62e3-bcde-498d-94f8-1babd5aca751 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1679 microversion: 2.1 time: 0.154509 Aug 08 02:34:36.318240 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 440/895] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:36 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:36.699895 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-e78111bf-a619-473d-9241-d38d87a8eb67 req-a97c282c-8f27-4040-bf4e-3bc69cce9504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68078741-87cd-4d1a-a760-fbc0dd0f29ef", "name": "network-vif-deleted", "tag": "fc502db4-9fb3-4112-bb84-be191e4232e5"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:36.713172 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-e78111bf-a619-473d-9241-d38d87a8eb67 req-a97c282c-8f27-4040-bf4e-3bc69cce9504 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:36.713794 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-e78111bf-a619-473d-9241-d38d87a8eb67 req-a97c282c-8f27-4040-bf4e-3bc69cce9504 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:36.714509 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-e78111bf-a619-473d-9241-d38d87a8eb67 req-a97c282c-8f27-4040-bf4e-3bc69cce9504 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:36.744752 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-e78111bf-a619-473d-9241-d38d87a8eb67 req-a97c282c-8f27-4040-bf4e-3bc69cce9504 service nova] Creating event network-vif-deleted:fc502db4-9fb3-4112-bb84-be191e4232e5 for instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef on hv-cinder-73306 Aug 08 02:34:36.751133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-e78111bf-a619-473d-9241-d38d87a8eb67 req-a97c282c-8f27-4040-bf4e-3bc69cce9504 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054789 Aug 08 02:34:36.751874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 456/896] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:34:37.339169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:37.339712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:37.346549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:37.347031 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:37.347458 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:37.348140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:37.348587 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:37.349007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:37.381354 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:37.381827 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:37.382274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:37.382721 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lazy-loading 'fault' on Instance uuid 68078741-87cd-4d1a-a760-fbc0dd0f29ef {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:34:37.427735 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:37.435236 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-72d159ff-a5eb-4f7c-8e37-7b6be89a7239 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 200 len: 1330 microversion: 2.1 time: 0.099964 Aug 08 02:34:37.436393 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 441/897] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:37 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:38.457918 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1f40c4b8-ee67-46ae-8ee8-89cacee853a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:38.458637 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1f40c4b8-ee67-46ae-8ee8-89cacee853a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:38.464888 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1f40c4b8-ee67-46ae-8ee8-89cacee853a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:38.465360 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1f40c4b8-ee67-46ae-8ee8-89cacee853a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:38.465784 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1f40c4b8-ee67-46ae-8ee8-89cacee853a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:38.466483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1f40c4b8-ee67-46ae-8ee8-89cacee853a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:38.466930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1f40c4b8-ee67-46ae-8ee8-89cacee853a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:38.467345 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1f40c4b8-ee67-46ae-8ee8-89cacee853a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:38.480203 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-1f40c4b8-ee67-46ae-8ee8-89cacee853a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1f40c4b8-ee67-46ae-8ee8-89cacee853a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef HTTP/1.1 Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:34:38.481782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:34:38.483443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:34:38.483443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:34:38.483443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:34:38.483443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:34:38.483443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:34:38.483443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:34:38.483443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:34:38.483443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:34:38.483443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:34:38.483443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:34:38.483443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:34:38.483443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '68078741-87cd-4d1a-a760-fbc0dd0f29ef'} Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:34:38.484290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:34:38.485581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:34:38.487249 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1f40c4b8-ee67-46ae-8ee8-89cacee853a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 404 to user: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:34:38.487249 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1f40c4b8-ee67-46ae-8ee8-89cacee853a2 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 404 len: 111 microversion: 2.1 time: 0.029995 Aug 08 02:34:38.487249 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 457/898] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:38 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:34:38.493008 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2b7adace-ff01-49be-b0a1-01f0f4b27f4d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '.version_select at 0x7f329588dd30>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:38.512356 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2b7adace-ff01-49be-b0a1-01f0f4b27f4d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-564635980" status: 202 len: 0 microversion: 2.1 time: 0.023130 Aug 08 02:34:38.512911 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 442/899] 10.222.0.39 () {58 vars in 1218 bytes} [Mon Aug 8 02:34:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-564635980 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:34:39.107394 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ee80b541-aded-46f3-b581-f0541780e58f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: .version_select at 0x7f32950bd280>, body: {"keypair": {"name": "tempest-keypair-1922015860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ7wEVahITItnJ9Um0KiYCkArD9+X4/fEeU7KYSj8rqF15ZXocCwLjHYlvmcdeEUbLXYCRvxe7funIFuKLrkV9FFflzeiCRLisVRQFeeenHAZMK4LO9cEnkju8wWxNmqQ=="}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:39.123134 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-ee80b541-aded-46f3-b581-f0541780e58f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'key_pairs'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:34:39.126907 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-ee80b541-aded-46f3-b581-f0541780e58f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for user 43dd72b161f8442285dea411741d66b3 and project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'key_pairs'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:34:39.148419 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ee80b541-aded-46f3-b581-f0541780e58f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044916 Aug 08 02:34:39.148989 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 458/900] 10.222.0.39 () {60 vars in 1159 bytes} [Mon Aug 8 02:34:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:40.399898 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-598322945", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a62e92c-7187-4f0e-842d-c113cd8a0af1"}], "security_groups": [{"name": "tempest-securitygroup--1656481488"}], "key_name": "tempest-keypair-1922015860", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:40.507137 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] validate_networks() for [('2a62e92c-7187-4f0e-842d-c113cd8a0af1', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:34:40.888666 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:34:40.889095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:34:40.889999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:34:40.890449 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:34:40.890867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:34:40.900118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:40.900597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:40.901031 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:40.901759 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:40.902213 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:40.902669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:40.919562 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:34:40.923514 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Getting quotas for user 43dd72b161f8442285dea411741d66b3 and project 3c533d28fa3f4d11b88b630a7c7bd1b4. Resources: {'instances', 'ram', 'cores'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:34:40.934269 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:34:40.936524 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:34:40.982840 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4fcd0631-703a-415b-9f2e-4b9ce89f64a8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.587534 Aug 08 02:34:40.983692 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 443/901] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:34:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:34:40.994694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7bae4a44-2be4-4bff-a845-612986970357 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:40.995506 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7bae4a44-2be4-4bff-a845-612986970357 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:41.054960 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7bae4a44-2be4-4bff-a845-612986970357 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:41.061687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7bae4a44-2be4-4bff-a845-612986970357 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1241 microversion: 2.1 time: 0.071321 Aug 08 02:34:41.062276 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 459/902] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:40 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:42.083067 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5c887cab-6c22-48a4-af70-6926bff2ad93 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:42.084317 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5c887cab-6c22-48a4-af70-6926bff2ad93 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:42.091508 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c887cab-6c22-48a4-af70-6926bff2ad93 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:42.092213 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c887cab-6c22-48a4-af70-6926bff2ad93 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:42.092811 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c887cab-6c22-48a4-af70-6926bff2ad93 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:42.093506 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c887cab-6c22-48a4-af70-6926bff2ad93 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:42.093952 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c887cab-6c22-48a4-af70-6926bff2ad93 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:42.094396 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c887cab-6c22-48a4-af70-6926bff2ad93 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:42.160992 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5c887cab-6c22-48a4-af70-6926bff2ad93 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:42.168764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5c887cab-6c22-48a4-af70-6926bff2ad93 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1311 microversion: 2.1 time: 0.090319 Aug 08 02:34:42.169360 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 444/903] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:42 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:43.190809 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dc727984-91b9-484c-a0de-80f6385da9d9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:43.192260 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-dc727984-91b9-484c-a0de-80f6385da9d9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:43.200180 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dc727984-91b9-484c-a0de-80f6385da9d9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:43.200770 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dc727984-91b9-484c-a0de-80f6385da9d9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:43.201273 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dc727984-91b9-484c-a0de-80f6385da9d9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:43.202416 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dc727984-91b9-484c-a0de-80f6385da9d9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:43.202992 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dc727984-91b9-484c-a0de-80f6385da9d9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:43.203653 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dc727984-91b9-484c-a0de-80f6385da9d9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:43.416761 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-dc727984-91b9-484c-a0de-80f6385da9d9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:43.425140 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-dc727984-91b9-484c-a0de-80f6385da9d9 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1367 microversion: 2.1 time: 0.238839 Aug 08 02:34:43.425724 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 460/904] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:43 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:43.702272 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-723bb845-2991-4717-ba3f-1a74ff70a5f1 req-6182b63d-d71a-4da7-863b-09e9dc936978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f771edb-4a7d-4509-b58f-af57c6e1d6d8", "tag": "3759ebe1-94c7-4ce7-a37e-9dd069547565"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:43.712269 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-723bb845-2991-4717-ba3f-1a74ff70a5f1 req-6182b63d-d71a-4da7-863b-09e9dc936978 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:43.712740 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-723bb845-2991-4717-ba3f-1a74ff70a5f1 req-6182b63d-d71a-4da7-863b-09e9dc936978 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:43.713175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-723bb845-2991-4717-ba3f-1a74ff70a5f1 req-6182b63d-d71a-4da7-863b-09e9dc936978 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:43.725986 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-723bb845-2991-4717-ba3f-1a74ff70a5f1 req-6182b63d-d71a-4da7-863b-09e9dc936978 service nova] Creating event network-changed:3759ebe1-94c7-4ce7-a37e-9dd069547565 for instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 on hv-cinder-73306 Aug 08 02:34:43.730867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-723bb845-2991-4717-ba3f-1a74ff70a5f1 req-6182b63d-d71a-4da7-863b-09e9dc936978 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032322 Aug 08 02:34:43.731468 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 445/905] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:44.446386 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e4558ba3-563c-4c28-8f02-ab955b104f59 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:44.447393 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e4558ba3-563c-4c28-8f02-ab955b104f59 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:44.453343 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e4558ba3-563c-4c28-8f02-ab955b104f59 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:44.453816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e4558ba3-563c-4c28-8f02-ab955b104f59 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:44.454240 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e4558ba3-563c-4c28-8f02-ab955b104f59 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:44.454933 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e4558ba3-563c-4c28-8f02-ab955b104f59 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:44.456112 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e4558ba3-563c-4c28-8f02-ab955b104f59 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:44.456723 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e4558ba3-563c-4c28-8f02-ab955b104f59 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:44.589374 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e4558ba3-563c-4c28-8f02-ab955b104f59 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:44.596623 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e4558ba3-563c-4c28-8f02-ab955b104f59 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1367 microversion: 2.1 time: 0.154220 Aug 08 02:34:44.597177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 461/906] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:44 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:45.617778 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-17e86c37-2924-4b2c-95d4-5a56d315c305 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:45.618534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-17e86c37-2924-4b2c-95d4-5a56d315c305 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:45.624598 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17e86c37-2924-4b2c-95d4-5a56d315c305 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:45.625077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17e86c37-2924-4b2c-95d4-5a56d315c305 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:45.625505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17e86c37-2924-4b2c-95d4-5a56d315c305 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:45.626182 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17e86c37-2924-4b2c-95d4-5a56d315c305 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:45.626650 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17e86c37-2924-4b2c-95d4-5a56d315c305 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:45.627554 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-17e86c37-2924-4b2c-95d4-5a56d315c305 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:45.754911 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-17e86c37-2924-4b2c-95d4-5a56d315c305 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:45.762156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-17e86c37-2924-4b2c-95d4-5a56d315c305 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1367 microversion: 2.1 time: 0.149028 Aug 08 02:34:45.762748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 446/907] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:45 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:46.783294 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c10f88d4-25e5-43d0-a722-464c95217f5d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:46.783911 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c10f88d4-25e5-43d0-a722-464c95217f5d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:46.790276 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c10f88d4-25e5-43d0-a722-464c95217f5d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:46.790757 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c10f88d4-25e5-43d0-a722-464c95217f5d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:46.791181 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c10f88d4-25e5-43d0-a722-464c95217f5d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:46.791859 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c10f88d4-25e5-43d0-a722-464c95217f5d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:46.792299 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c10f88d4-25e5-43d0-a722-464c95217f5d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:46.792711 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c10f88d4-25e5-43d0-a722-464c95217f5d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:46.919783 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c10f88d4-25e5-43d0-a722-464c95217f5d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:46.927950 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c10f88d4-25e5-43d0-a722-464c95217f5d tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1367 microversion: 2.1 time: 0.148560 Aug 08 02:34:46.928529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 462/908] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:46 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:47.948911 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-afe646ee-86ac-4229-acc9-02b6c0cc0f94 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:47.949528 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-afe646ee-86ac-4229-acc9-02b6c0cc0f94 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:47.956004 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afe646ee-86ac-4229-acc9-02b6c0cc0f94 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:47.956486 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afe646ee-86ac-4229-acc9-02b6c0cc0f94 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:47.956922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afe646ee-86ac-4229-acc9-02b6c0cc0f94 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:47.957614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afe646ee-86ac-4229-acc9-02b6c0cc0f94 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:47.958067 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afe646ee-86ac-4229-acc9-02b6c0cc0f94 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:47.958519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afe646ee-86ac-4229-acc9-02b6c0cc0f94 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:48.083727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-afe646ee-86ac-4229-acc9-02b6c0cc0f94 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:48.091154 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-afe646ee-86ac-4229-acc9-02b6c0cc0f94 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1367 microversion: 2.1 time: 0.146162 Aug 08 02:34:48.091720 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 447/909] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:47 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:49.112650 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a78279bd-5699-4a4b-999e-bd015b53b206 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:49.113292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a78279bd-5699-4a4b-999e-bd015b53b206 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:49.119930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a78279bd-5699-4a4b-999e-bd015b53b206 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:49.120362 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a78279bd-5699-4a4b-999e-bd015b53b206 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:49.120788 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a78279bd-5699-4a4b-999e-bd015b53b206 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:49.121466 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a78279bd-5699-4a4b-999e-bd015b53b206 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:49.121916 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a78279bd-5699-4a4b-999e-bd015b53b206 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:49.122365 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a78279bd-5699-4a4b-999e-bd015b53b206 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:49.253701 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a78279bd-5699-4a4b-999e-bd015b53b206 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:49.256113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:49.263010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a78279bd-5699-4a4b-999e-bd015b53b206 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1367 microversion: 2.1 time: 0.154749 Aug 08 02:34:49.263585 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 463/910] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:49 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:50.283682 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7ea4fcd1-ec19-4589-af5c-90d702a881b0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:50.284291 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7ea4fcd1-ec19-4589-af5c-90d702a881b0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:50.290675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ea4fcd1-ec19-4589-af5c-90d702a881b0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:50.291150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ea4fcd1-ec19-4589-af5c-90d702a881b0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:50.291580 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ea4fcd1-ec19-4589-af5c-90d702a881b0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:50.292259 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ea4fcd1-ec19-4589-af5c-90d702a881b0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:50.292706 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ea4fcd1-ec19-4589-af5c-90d702a881b0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:50.293124 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ea4fcd1-ec19-4589-af5c-90d702a881b0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:50.297039 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:50.432578 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7ea4fcd1-ec19-4589-af5c-90d702a881b0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:50.440642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7ea4fcd1-ec19-4589-af5c-90d702a881b0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1367 microversion: 2.1 time: 0.160845 Aug 08 02:34:50.441211 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 448/911] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:50 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:51.031771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-8cbf627d-2a40-4b41-8988-c75f872ff3f9 req-0d29b502-4cfe-4bc9-adb7-023f507583f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f771edb-4a7d-4509-b58f-af57c6e1d6d8", "name": "network-vif-plugged", "status": "completed", "tag": "3759ebe1-94c7-4ce7-a37e-9dd069547565"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:51.043961 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-8cbf627d-2a40-4b41-8988-c75f872ff3f9 req-0d29b502-4cfe-4bc9-adb7-023f507583f3 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:51.044437 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-8cbf627d-2a40-4b41-8988-c75f872ff3f9 req-0d29b502-4cfe-4bc9-adb7-023f507583f3 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:51.044862 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-8cbf627d-2a40-4b41-8988-c75f872ff3f9 req-0d29b502-4cfe-4bc9-adb7-023f507583f3 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:51.056599 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-8cbf627d-2a40-4b41-8988-c75f872ff3f9 req-0d29b502-4cfe-4bc9-adb7-023f507583f3 service nova] Creating event network-vif-plugged:3759ebe1-94c7-4ce7-a37e-9dd069547565 for instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 on hv-cinder-73306 Aug 08 02:34:51.060242 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=6 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:51.062422 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-8cbf627d-2a40-4b41-8988-c75f872ff3f9 req-0d29b502-4cfe-4bc9-adb7-023f507583f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034645 Aug 08 02:34:51.063015 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 464/912] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:51.462039 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-814248d3-51b1-4e47-b130-9d7f01d9abca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:51.462681 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-814248d3-51b1-4e47-b130-9d7f01d9abca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:51.464511 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:51.465375 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:34:51.472113 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-814248d3-51b1-4e47-b130-9d7f01d9abca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:51.472588 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-814248d3-51b1-4e47-b130-9d7f01d9abca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:51.473017 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-814248d3-51b1-4e47-b130-9d7f01d9abca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:51.473703 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-814248d3-51b1-4e47-b130-9d7f01d9abca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:51.474153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-814248d3-51b1-4e47-b130-9d7f01d9abca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:51.474596 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-814248d3-51b1-4e47-b130-9d7f01d9abca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:51.605203 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-814248d3-51b1-4e47-b130-9d7f01d9abca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:51.612536 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-814248d3-51b1-4e47-b130-9d7f01d9abca tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1367 microversion: 2.1 time: 0.154394 Aug 08 02:34:51.613097 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 449/913] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:51 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:52.633544 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-97715913-05f2-42b2-a38b-8e479092032b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:52.634304 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-97715913-05f2-42b2-a38b-8e479092032b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:52.640862 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-97715913-05f2-42b2-a38b-8e479092032b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:52.641339 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-97715913-05f2-42b2-a38b-8e479092032b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:52.641769 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-97715913-05f2-42b2-a38b-8e479092032b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:52.643139 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-97715913-05f2-42b2-a38b-8e479092032b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:52.643599 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-97715913-05f2-42b2-a38b-8e479092032b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:52.644021 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-97715913-05f2-42b2-a38b-8e479092032b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:52.771512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-97715913-05f2-42b2-a38b-8e479092032b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:52.780583 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-97715913-05f2-42b2-a38b-8e479092032b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1367 microversion: 2.1 time: 0.151536 Aug 08 02:34:52.781950 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 465/914] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:52 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:53.802010 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d6cd7536-4c65-40f5-a49c-d378255e0b05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:53.802684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d6cd7536-4c65-40f5-a49c-d378255e0b05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:53.809033 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6cd7536-4c65-40f5-a49c-d378255e0b05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:53.809515 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6cd7536-4c65-40f5-a49c-d378255e0b05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:53.809950 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6cd7536-4c65-40f5-a49c-d378255e0b05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:53.810662 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6cd7536-4c65-40f5-a49c-d378255e0b05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:53.811115 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6cd7536-4c65-40f5-a49c-d378255e0b05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:53.811534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6cd7536-4c65-40f5-a49c-d378255e0b05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:53.940822 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d6cd7536-4c65-40f5-a49c-d378255e0b05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:34:53.948740 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d6cd7536-4c65-40f5-a49c-d378255e0b05 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1558 microversion: 2.1 time: 0.150572 Aug 08 02:34:53.949296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 450/915] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:34:53 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:34:53.968885 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-afb2ce90-4c4f-47ee-8edd-bb3f395ffd45 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:34:53.969406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-afb2ce90-4c4f-47ee-8edd-bb3f395ffd45 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:34:53.975720 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afb2ce90-4c4f-47ee-8edd-bb3f395ffd45 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:53.976188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afb2ce90-4c4f-47ee-8edd-bb3f395ffd45 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:53.976609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afb2ce90-4c4f-47ee-8edd-bb3f395ffd45 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:53.977282 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afb2ce90-4c4f-47ee-8edd-bb3f395ffd45 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:53.977727 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afb2ce90-4c4f-47ee-8edd-bb3f395ffd45 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:53.978142 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afb2ce90-4c4f-47ee-8edd-bb3f395ffd45 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:54.057483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-afb2ce90-4c4f-47ee-8edd-bb3f395ffd45 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092344 Aug 08 02:34:54.058073 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 466/916] 10.222.0.39 () {58 vars in 1275 bytes} [Mon Aug 8 02:34:53 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:34:54.962283 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-616d3181-4216-4bfc-9b51-1aa41d464a4b req-f4fb5ae8-5ec9-4a1e-9bcd-b66efa70a53b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f771edb-4a7d-4509-b58f-af57c6e1d6d8", "tag": "3759ebe1-94c7-4ce7-a37e-9dd069547565"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:34:54.972468 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-616d3181-4216-4bfc-9b51-1aa41d464a4b req-f4fb5ae8-5ec9-4a1e-9bcd-b66efa70a53b service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:34:54.972946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-616d3181-4216-4bfc-9b51-1aa41d464a4b req-f4fb5ae8-5ec9-4a1e-9bcd-b66efa70a53b service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:34:54.973381 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-616d3181-4216-4bfc-9b51-1aa41d464a4b req-f4fb5ae8-5ec9-4a1e-9bcd-b66efa70a53b service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:34:54.984359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-616d3181-4216-4bfc-9b51-1aa41d464a4b req-f4fb5ae8-5ec9-4a1e-9bcd-b66efa70a53b service nova] Creating event network-changed:3759ebe1-94c7-4ce7-a37e-9dd069547565 for instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 on hv-cinder-73306 Aug 08 02:34:54.989941 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-616d3181-4216-4bfc-9b51-1aa41d464a4b req-f4fb5ae8-5ec9-4a1e-9bcd-b66efa70a53b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031204 Aug 08 02:34:54.990570 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 451/917] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:29.686874 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:29.687639 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=13 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:29.692543 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5d7fa891-b0e9-4d59-8b5f-b29234bc72ec tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:29.693026 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5d7fa891-b0e9-4d59-8b5f-b29234bc72ec tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:29.700046 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5d7fa891-b0e9-4d59-8b5f-b29234bc72ec tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:29.700466 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5d7fa891-b0e9-4d59-8b5f-b29234bc72ec tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:29.700892 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5d7fa891-b0e9-4d59-8b5f-b29234bc72ec tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:29.701577 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5d7fa891-b0e9-4d59-8b5f-b29234bc72ec tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:29.702035 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5d7fa891-b0e9-4d59-8b5f-b29234bc72ec tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:29.702481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5d7fa891-b0e9-4d59-8b5f-b29234bc72ec tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:29.726984 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5d7fa891-b0e9-4d59-8b5f-b29234bc72ec tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/ips" status: 200 len: 146 microversion: 2.1 time: 0.041635 Aug 08 02:35:29.727539 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 467/918] 10.222.0.39 () {58 vars in 1248 bytes} [Mon Aug 8 02:35:29 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:32.107742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:32.108482 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=19 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:32.114047 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4782b098-cadd-4a8f-bd8a-98c8973a055c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5523ac0c-63d9-4a82-9163-9fdae1c401ca"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:32.116438 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4782b098-cadd-4a8f-bd8a-98c8973a055c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:32.123776 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4782b098-cadd-4a8f-bd8a-98c8973a055c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:32.124258 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4782b098-cadd-4a8f-bd8a-98c8973a055c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:32.124690 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4782b098-cadd-4a8f-bd8a-98c8973a055c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:32.125376 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4782b098-cadd-4a8f-bd8a-98c8973a055c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:32.125827 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4782b098-cadd-4a8f-bd8a-98c8973a055c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:32.126272 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4782b098-cadd-4a8f-bd8a-98c8973a055c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:32.553441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4782b098-cadd-4a8f-bd8a-98c8973a055c tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "POST /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446961 Aug 08 02:35:32.554061 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 452/919] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:35:32 2022] POST /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments => generated 194 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:40.069028 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f1b36282-a150-4e83-8abe-4eea35a3f45f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:40.071175 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f1b36282-a150-4e83-8abe-4eea35a3f45f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:40.073103 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:40.073740 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=4 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:35:40.079562 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f1b36282-a150-4e83-8abe-4eea35a3f45f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:40.080045 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f1b36282-a150-4e83-8abe-4eea35a3f45f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:40.080474 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f1b36282-a150-4e83-8abe-4eea35a3f45f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:40.081153 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f1b36282-a150-4e83-8abe-4eea35a3f45f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:40.082109 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f1b36282-a150-4e83-8abe-4eea35a3f45f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:40.082549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f1b36282-a150-4e83-8abe-4eea35a3f45f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:40.111358 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f1b36282-a150-4e83-8abe-4eea35a3f45f tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046614 Aug 08 02:35:40.111899 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 468/920] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:35:40 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:40.122785 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-97a310bc-1fb6-4e4f-badb-7bc042a61053 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:40.123362 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-97a310bc-1fb6-4e4f-badb-7bc042a61053 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:40.129941 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97a310bc-1fb6-4e4f-badb-7bc042a61053 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:40.130456 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97a310bc-1fb6-4e4f-badb-7bc042a61053 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:40.130890 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97a310bc-1fb6-4e4f-badb-7bc042a61053 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:40.131565 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97a310bc-1fb6-4e4f-badb-7bc042a61053 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:40.132012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97a310bc-1fb6-4e4f-badb-7bc042a61053 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:40.132427 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-97a310bc-1fb6-4e4f-badb-7bc042a61053 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:40.160538 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-97a310bc-1fb6-4e4f-badb-7bc042a61053 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments/5523ac0c-63d9-4a82-9163-9fdae1c401ca" status: 200 len: 194 microversion: 2.1 time: 0.042123 Aug 08 02:35:40.161098 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 453/921] 10.222.0.39 () {58 vars in 1413 bytes} [Mon Aug 8 02:35:40 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments/5523ac0c-63d9-4a82-9163-9fdae1c401ca => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:41.486420 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-228a342c-83a0-4ef1-914c-47143774db30 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1562716-48c4-4e97-9bed-fa075bce06ca"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:41.488675 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-228a342c-83a0-4ef1-914c-47143774db30 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:41.494998 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-228a342c-83a0-4ef1-914c-47143774db30 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:41.495481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-228a342c-83a0-4ef1-914c-47143774db30 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:41.495912 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-228a342c-83a0-4ef1-914c-47143774db30 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:41.496593 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-228a342c-83a0-4ef1-914c-47143774db30 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:41.497043 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-228a342c-83a0-4ef1-914c-47143774db30 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:41.497465 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-228a342c-83a0-4ef1-914c-47143774db30 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:41.822442 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-228a342c-83a0-4ef1-914c-47143774db30 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "POST /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339647 Aug 08 02:35:41.825605 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 469/922] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:35:41 2022] POST /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:49.341044 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-40229e9e-6230-40ea-884f-e2a47eb6a4d4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:49.343338 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-40229e9e-6230-40ea-884f-e2a47eb6a4d4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:49.349804 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40229e9e-6230-40ea-884f-e2a47eb6a4d4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:49.350315 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40229e9e-6230-40ea-884f-e2a47eb6a4d4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:49.350756 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40229e9e-6230-40ea-884f-e2a47eb6a4d4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:49.351445 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40229e9e-6230-40ea-884f-e2a47eb6a4d4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:49.351897 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40229e9e-6230-40ea-884f-e2a47eb6a4d4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:49.352319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40229e9e-6230-40ea-884f-e2a47eb6a4d4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:49.381238 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-40229e9e-6230-40ea-884f-e2a47eb6a4d4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044207 Aug 08 02:35:49.381782 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 454/923] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:35:49 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:49.526688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-717a4bfc-3c7b-440c-9d5d-cc42b0f5a571 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:49.527270 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-717a4bfc-3c7b-440c-9d5d-cc42b0f5a571 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:49.533429 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-717a4bfc-3c7b-440c-9d5d-cc42b0f5a571 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:49.533909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-717a4bfc-3c7b-440c-9d5d-cc42b0f5a571 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:49.534378 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-717a4bfc-3c7b-440c-9d5d-cc42b0f5a571 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:49.535069 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-717a4bfc-3c7b-440c-9d5d-cc42b0f5a571 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:49.535585 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-717a4bfc-3c7b-440c-9d5d-cc42b0f5a571 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:49.536443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-717a4bfc-3c7b-440c-9d5d-cc42b0f5a571 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:49.563635 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-717a4bfc-3c7b-440c-9d5d-cc42b0f5a571 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments/5523ac0c-63d9-4a82-9163-9fdae1c401ca" status: 200 len: 194 microversion: 2.1 time: 0.041781 Aug 08 02:35:49.564204 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 470/924] 10.222.0.39 () {58 vars in 1413 bytes} [Mon Aug 8 02:35:49 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments/5523ac0c-63d9-4a82-9163-9fdae1c401ca => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:49.575016 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6d8bf5c9-4aa1-4d9a-a90f-ce05e52443c9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:49.575512 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6d8bf5c9-4aa1-4d9a-a90f-ce05e52443c9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:49.581310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d8bf5c9-4aa1-4d9a-a90f-ce05e52443c9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:49.581785 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d8bf5c9-4aa1-4d9a-a90f-ce05e52443c9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:49.582213 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d8bf5c9-4aa1-4d9a-a90f-ce05e52443c9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:49.583594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d8bf5c9-4aa1-4d9a-a90f-ce05e52443c9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:49.584041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d8bf5c9-4aa1-4d9a-a90f-ce05e52443c9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:49.584462 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d8bf5c9-4aa1-4d9a-a90f-ce05e52443c9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:49.662091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-6d8bf5c9-4aa1-4d9a-a90f-ce05e52443c9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lazy-loading 'services' on Instance uuid c7c1eeb6-26c2-4706-8b39-0f233449617a {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:35:49.731614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6d8bf5c9-4aa1-4d9a-a90f-ce05e52443c9 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments/5523ac0c-63d9-4a82-9163-9fdae1c401ca" status: 202 len: 0 microversion: 2.1 time: 0.160325 Aug 08 02:35:49.732302 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 455/925] 10.222.0.39 () {58 vars in 1416 bytes} [Mon Aug 8 02:35:49 2022] DELETE /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments/5523ac0c-63d9-4a82-9163-9fdae1c401ca => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:35:51.906875 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a07f1c05-77cb-492d-bea4-12c4f9cddd20 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:51.907370 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a07f1c05-77cb-492d-bea4-12c4f9cddd20 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:51.914328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a07f1c05-77cb-492d-bea4-12c4f9cddd20 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:51.914801 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a07f1c05-77cb-492d-bea4-12c4f9cddd20 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:51.915226 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a07f1c05-77cb-492d-bea4-12c4f9cddd20 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:51.915904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a07f1c05-77cb-492d-bea4-12c4f9cddd20 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:51.916348 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a07f1c05-77cb-492d-bea4-12c4f9cddd20 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:51.916768 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a07f1c05-77cb-492d-bea4-12c4f9cddd20 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:51.945100 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a07f1c05-77cb-492d-bea4-12c4f9cddd20 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments/d1562716-48c4-4e97-9bed-fa075bce06ca" status: 200 len: 194 microversion: 2.1 time: 0.042207 Aug 08 02:35:51.945662 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 471/926] 10.222.0.39 () {58 vars in 1413 bytes} [Mon Aug 8 02:35:51 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments/d1562716-48c4-4e97-9bed-fa075bce06ca => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:51.957136 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ef34aaed-0c99-430a-9653-337cb14b5c92 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:51.958273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ef34aaed-0c99-430a-9653-337cb14b5c92 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:51.964364 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef34aaed-0c99-430a-9653-337cb14b5c92 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:51.964848 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef34aaed-0c99-430a-9653-337cb14b5c92 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:51.965287 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef34aaed-0c99-430a-9653-337cb14b5c92 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:51.965975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef34aaed-0c99-430a-9653-337cb14b5c92 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:51.966473 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef34aaed-0c99-430a-9653-337cb14b5c92 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:51.966899 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef34aaed-0c99-430a-9653-337cb14b5c92 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:52.046363 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-ef34aaed-0c99-430a-9653-337cb14b5c92 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lazy-loading 'services' on Instance uuid c7c1eeb6-26c2-4706-8b39-0f233449617a {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:35:52.116570 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ef34aaed-0c99-430a-9653-337cb14b5c92 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments/d1562716-48c4-4e97-9bed-fa075bce06ca" status: 202 len: 0 microversion: 2.1 time: 0.164022 Aug 08 02:35:52.117120 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 456/927] 10.222.0.39 () {58 vars in 1416 bytes} [Mon Aug 8 02:35:51 2022] DELETE /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments/d1562716-48c4-4e97-9bed-fa075bce06ca => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:35:53.279861 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c342f23d-d3fd-420b-9074-f678275ef6de tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:53.282071 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c342f23d-d3fd-420b-9074-f678275ef6de tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:53.288899 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c342f23d-d3fd-420b-9074-f678275ef6de tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.289378 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c342f23d-d3fd-420b-9074-f678275ef6de tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.289805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c342f23d-d3fd-420b-9074-f678275ef6de tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.290541 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c342f23d-d3fd-420b-9074-f678275ef6de tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.290990 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c342f23d-d3fd-420b-9074-f678275ef6de tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.291408 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c342f23d-d3fd-420b-9074-f678275ef6de tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.319748 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c342f23d-d3fd-420b-9074-f678275ef6de tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043820 Aug 08 02:35:53.320289 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 472/928] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:35:53 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:35:53.430334 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1d88ce93-0048-48cc-a6e4-50888164f9a5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:53.432492 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1d88ce93-0048-48cc-a6e4-50888164f9a5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:53.438641 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d88ce93-0048-48cc-a6e4-50888164f9a5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.439118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d88ce93-0048-48cc-a6e4-50888164f9a5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.439544 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d88ce93-0048-48cc-a6e4-50888164f9a5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.440521 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d88ce93-0048-48cc-a6e4-50888164f9a5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.440967 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d88ce93-0048-48cc-a6e4-50888164f9a5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.441390 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1d88ce93-0048-48cc-a6e4-50888164f9a5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.469740 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1d88ce93-0048-48cc-a6e4-50888164f9a5 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045071 Aug 08 02:35:53.470299 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 457/929] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:35:53 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:35:53.530138 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b46f3243-2e04-4722-8781-933da87156c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:53.530920 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b46f3243-2e04-4722-8781-933da87156c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:53.538279 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b46f3243-2e04-4722-8781-933da87156c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.538417 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b46f3243-2e04-4722-8781-933da87156c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.538894 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b46f3243-2e04-4722-8781-933da87156c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.539661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b46f3243-2e04-4722-8781-933da87156c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.540177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b46f3243-2e04-4722-8781-933da87156c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.540724 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b46f3243-2e04-4722-8781-933da87156c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.564794 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b46f3243-2e04-4722-8781-933da87156c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:35:53.636111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b46f3243-2e04-4722-8781-933da87156c4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 204 len: 0 microversion: 2.1 time: 0.109506 Aug 08 02:35:53.636683 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 473/930] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:35:53 2022] DELETE /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:35:53.645432 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d6328309-7eec-4832-9eb1-495ca1faec95 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:53.646039 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d6328309-7eec-4832-9eb1-495ca1faec95 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:53.652113 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6328309-7eec-4832-9eb1-495ca1faec95 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.652588 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6328309-7eec-4832-9eb1-495ca1faec95 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.653019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6328309-7eec-4832-9eb1-495ca1faec95 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.653699 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6328309-7eec-4832-9eb1-495ca1faec95 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:53.654144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6328309-7eec-4832-9eb1-495ca1faec95 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:53.654583 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d6328309-7eec-4832-9eb1-495ca1faec95 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:53.781961 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d6328309-7eec-4832-9eb1-495ca1faec95 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:53.790793 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d6328309-7eec-4832-9eb1-495ca1faec95 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1673 microversion: 2.1 time: 0.149653 Aug 08 02:35:53.791365 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 458/931] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:53 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:54.811700 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-23d43d36-5f2b-45d9-8b23-02f63de159b4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:54.812397 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-23d43d36-5f2b-45d9-8b23-02f63de159b4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:54.818932 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-23d43d36-5f2b-45d9-8b23-02f63de159b4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:54.819413 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-23d43d36-5f2b-45d9-8b23-02f63de159b4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:54.819843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-23d43d36-5f2b-45d9-8b23-02f63de159b4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:54.820527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-23d43d36-5f2b-45d9-8b23-02f63de159b4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:54.820976 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-23d43d36-5f2b-45d9-8b23-02f63de159b4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:54.821392 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-23d43d36-5f2b-45d9-8b23-02f63de159b4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:55.198205 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-23d43d36-5f2b-45d9-8b23-02f63de159b4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:55.205599 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-23d43d36-5f2b-45d9-8b23-02f63de159b4 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1673 microversion: 2.1 time: 0.398150 Aug 08 02:35:55.206169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 474/932] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:54 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1673 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:56.227558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5b4f3939-62ee-464a-be9d-cc3cd32bca7e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:56.228176 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5b4f3939-62ee-464a-be9d-cc3cd32bca7e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:56.234491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b4f3939-62ee-464a-be9d-cc3cd32bca7e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:56.234970 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b4f3939-62ee-464a-be9d-cc3cd32bca7e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:56.235395 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b4f3939-62ee-464a-be9d-cc3cd32bca7e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:56.236082 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b4f3939-62ee-464a-be9d-cc3cd32bca7e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:56.236530 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b4f3939-62ee-464a-be9d-cc3cd32bca7e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:56.236947 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b4f3939-62ee-464a-be9d-cc3cd32bca7e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:56.370751 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5b4f3939-62ee-464a-be9d-cc3cd32bca7e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:56.378152 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5b4f3939-62ee-464a-be9d-cc3cd32bca7e tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1673 microversion: 2.1 time: 0.154485 Aug 08 02:35:56.378972 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 459/933] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:56 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:56.971335 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-d09145e2-2c16-486f-81e9-ae05c824ef7d req-0296c150-7a0e-4959-abdc-307e44546082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7c1eeb6-26c2-4706-8b39-0f233449617a", "name": "network-vif-deleted", "tag": "70635be5-8521-49ef-a849-31a2ed0e85ee"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:35:56.980999 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-d09145e2-2c16-486f-81e9-ae05c824ef7d req-0296c150-7a0e-4959-abdc-307e44546082 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:56.981467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-d09145e2-2c16-486f-81e9-ae05c824ef7d req-0296c150-7a0e-4959-abdc-307e44546082 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:56.981887 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-d09145e2-2c16-486f-81e9-ae05c824ef7d req-0296c150-7a0e-4959-abdc-307e44546082 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:56.994703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-d09145e2-2c16-486f-81e9-ae05c824ef7d req-0296c150-7a0e-4959-abdc-307e44546082 service nova] Creating event network-vif-deleted:70635be5-8521-49ef-a849-31a2ed0e85ee for instance c7c1eeb6-26c2-4706-8b39-0f233449617a on hv-cinder-73306 Aug 08 02:35:57.001359 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-d09145e2-2c16-486f-81e9-ae05c824ef7d req-0296c150-7a0e-4959-abdc-307e44546082 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033529 Aug 08 02:35:57.002058 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 475/934] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:35:57.401035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:57.401756 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:57.408362 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:57.408926 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:57.409421 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:57.410310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:57.411089 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:57.411535 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:57.464835 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:57.465396 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:57.466757 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:57.467471 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lazy-loading 'fault' on Instance uuid c7c1eeb6-26c2-4706-8b39-0f233449617a {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:35:57.516168 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17286ff2e1764ec7b91e6274c7162437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7098cc9f24d9dbc4695789c5b87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:35:57.523726 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3a9a007c-cf35-4161-917b-5b2e72192145 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 200 len: 1327 microversion: 2.1 time: 0.127582 Aug 08 02:35:57.524477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 460/935] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:57 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 1327 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:35:58.545961 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-81972501-bbde-4da1-94c8-2b0fc05b7029 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:58.546679 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-81972501-bbde-4da1-94c8-2b0fc05b7029 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:58.553537 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-81972501-bbde-4da1-94c8-2b0fc05b7029 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:58.554010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-81972501-bbde-4da1-94c8-2b0fc05b7029 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:58.554471 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-81972501-bbde-4da1-94c8-2b0fc05b7029 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:58.555150 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-81972501-bbde-4da1-94c8-2b0fc05b7029 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:58.555593 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-81972501-bbde-4da1-94c8-2b0fc05b7029 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:58.556009 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-81972501-bbde-4da1-94c8-2b0fc05b7029 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:58.570368 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-81972501-bbde-4da1-94c8-2b0fc05b7029 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] HTTP exception thrown: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-81972501-bbde-4da1-94c8-2b0fc05b7029 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Request method failure captured: Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a HTTP/1.1 Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQg6mzkESqN9A5oZoJ_yeaR8QfkHsuvn7Gnn2Of1q2nwdQWnQJsPQf7qgT1Axr81h4HAPGOPgqHfOOvS3gMsBaNHu9AkrckqNK2QaYCwUHVJESFMZ0zfM2kScAxe3rDA_c-SQ_zKz8JbK3skckXwUZSe3rHR_eIsjUX7TcWIxReByQ Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 9ae7098cc9f24d9dbc4695789c5b87b4 Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:35:58.571934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:35:58.573512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ae7098cc9f24d9dbc4695789c5b87b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ae7098cc9f24d9dbc4695789c5b87b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ae7098cc9f24d9dbc4695789c5b87b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ae7098cc9f24d9dbc4695789c5b87b4"}]}] Aug 08 02:35:58.573512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:35:58.573512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 9ae7098cc9f24d9dbc4695789c5b87b4 Aug 08 02:35:58.573512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:35:58.573512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeTestJSON-603930406-project Aug 08 02:35:58.573512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:35:58.573512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:35:58.573512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 17286ff2e1764ec7b91e6274c7162437 Aug 08 02:35:58.573512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeTestJSON-603930406-project Aug 08 02:35:58.573512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:35:58.573512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:35:58.573512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': 'c7c1eeb6-26c2-4706-8b39-0f233449617a'} Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:35:58.574530 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:35:58.576077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:35:58.577509 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-81972501-bbde-4da1-94c8-2b0fc05b7029 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Returning 404 to user: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:35:58.577509 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-81972501-bbde-4da1-94c8-2b0fc05b7029 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 404 len: 111 microversion: 2.1 time: 0.032030 Aug 08 02:35:58.577509 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 476/936] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:35:58 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:35:58.581945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7b39c003-ac92-43d3-bc49-9c8459712b25 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '.version_select at 0x7f329594bee0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:58.600242 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7b39c003-ac92-43d3-bc49-9c8459712b25 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-981984283" status: 202 len: 0 microversion: 2.1 time: 0.022011 Aug 08 02:35:58.600774 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 461/937] 10.222.0.39 () {58 vars in 1218 bytes} [Mon Aug 8 02:35:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-981984283 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:35:59.646069 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f70b21c3-cdd2-4902-b52c-c4d78ba2762e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:35:59.646601 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f70b21c3-cdd2-4902-b52c-c4d78ba2762e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:35:59.652586 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f70b21c3-cdd2-4902-b52c-c4d78ba2762e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:59.653059 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f70b21c3-cdd2-4902-b52c-c4d78ba2762e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:59.653516 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f70b21c3-cdd2-4902-b52c-c4d78ba2762e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:59.654193 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f70b21c3-cdd2-4902-b52c-c4d78ba2762e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:35:59.654671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f70b21c3-cdd2-4902-b52c-c4d78ba2762e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:35:59.655090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f70b21c3-cdd2-4902-b52c-c4d78ba2762e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:35:59.678507 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f70b21c3-cdd2-4902-b52c-c4d78ba2762e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/ips" status: 200 len: 152 microversion: 2.20 time: 0.036287 Aug 08 02:35:59.679053 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 477/938] 10.222.0.39 () {60 vars in 1289 bytes} [Mon Aug 8 02:35:59 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:36:02.516118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-51775415-689e-4b0a-8d1b-fadaf42d1bdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:02.516605 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-51775415-689e-4b0a-8d1b-fadaf42d1bdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:02.518822 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:02.525234 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51775415-689e-4b0a-8d1b-fadaf42d1bdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:02.525718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51775415-689e-4b0a-8d1b-fadaf42d1bdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:02.526150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51775415-689e-4b0a-8d1b-fadaf42d1bdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:02.526865 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51775415-689e-4b0a-8d1b-fadaf42d1bdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:02.527319 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51775415-689e-4b0a-8d1b-fadaf42d1bdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:02.527736 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51775415-689e-4b0a-8d1b-fadaf42d1bdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:02.530919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:02.543272 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-51775415-689e-4b0a-8d1b-fadaf42d1bdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] HTTP exception thrown: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-51775415-689e-4b0a-8d1b-fadaf42d1bdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Request method failure captured: Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a HTTP/1.1 Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQg6mzkESqN9A5oZoJ_yeaR8QfkHsuvn7Gnn2Of1q2nwdQWnQJsPQf7qgT1Axr81h4HAPGOPgqHfOOvS3gMsBaNHu9AkrckqNK2QaYCwUHVJESFMZ0zfM2kScAxe3rDA_c-SQ_zKz8JbK3skckXwUZSe3rHR_eIsjUX7TcWIxReByQ Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 9ae7098cc9f24d9dbc4695789c5b87b4 Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:36:02.544994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:36:02.546594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ae7098cc9f24d9dbc4695789c5b87b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ae7098cc9f24d9dbc4695789c5b87b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ae7098cc9f24d9dbc4695789c5b87b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ae7098cc9f24d9dbc4695789c5b87b4"}]}] Aug 08 02:36:02.546594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:36:02.546594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 9ae7098cc9f24d9dbc4695789c5b87b4 Aug 08 02:36:02.546594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:36:02.546594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeTestJSON-603930406-project Aug 08 02:36:02.546594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:36:02.546594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:36:02.546594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 17286ff2e1764ec7b91e6274c7162437 Aug 08 02:36:02.546594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeTestJSON-603930406-project Aug 08 02:36:02.546594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:36:02.546594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:36:02.546594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': 'c7c1eeb6-26c2-4706-8b39-0f233449617a'} Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:36:02.547335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:36:02.548558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:36:02.549719 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-51775415-689e-4b0a-8d1b-fadaf42d1bdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Returning 404 to user: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:36:02.549719 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-51775415-689e-4b0a-8d1b-fadaf42d1bdf tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 404 len: 111 microversion: 2.1 time: 0.034772 Aug 08 02:36:02.549719 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 462/939] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:36:02 2022] DELETE /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:36:02.554630 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0a91648a-0f04-4855-8725-f673fba1d3cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:02.555241 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0a91648a-0f04-4855-8725-f673fba1d3cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: c7c1eeb6-26c2-4706-8b39-0f233449617a] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:02.562185 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0a91648a-0f04-4855-8725-f673fba1d3cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:02.562700 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0a91648a-0f04-4855-8725-f673fba1d3cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:02.563129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0a91648a-0f04-4855-8725-f673fba1d3cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:02.563810 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0a91648a-0f04-4855-8725-f673fba1d3cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:02.564258 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0a91648a-0f04-4855-8725-f673fba1d3cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:02.564680 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0a91648a-0f04-4855-8725-f673fba1d3cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:02.578536 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-0a91648a-0f04-4855-8725-f673fba1d3cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] HTTP exception thrown: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0a91648a-0f04-4855-8725-f673fba1d3cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Request method failure captured: Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a HTTP/1.1 Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQg6mzkESqN9A5oZoJ_yeaR8QfkHsuvn7Gnn2Of1q2nwdQWnQJsPQf7qgT1Axr81h4HAPGOPgqHfOOvS3gMsBaNHu9AkrckqNK2QaYCwUHVJESFMZ0zfM2kScAxe3rDA_c-SQ_zKz8JbK3skckXwUZSe3rHR_eIsjUX7TcWIxReByQ Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 9ae7098cc9f24d9dbc4695789c5b87b4 Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:36:02.580079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:36:02.581687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ae7098cc9f24d9dbc4695789c5b87b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ae7098cc9f24d9dbc4695789c5b87b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ae7098cc9f24d9dbc4695789c5b87b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ae7098cc9f24d9dbc4695789c5b87b4"}]}] Aug 08 02:36:02.581687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:36:02.581687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 9ae7098cc9f24d9dbc4695789c5b87b4 Aug 08 02:36:02.581687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:36:02.581687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeTestJSON-603930406-project Aug 08 02:36:02.581687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:36:02.581687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:36:02.581687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 17286ff2e1764ec7b91e6274c7162437 Aug 08 02:36:02.581687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeTestJSON-603930406-project Aug 08 02:36:02.581687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:36:02.581687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:36:02.581687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': 'c7c1eeb6-26c2-4706-8b39-0f233449617a'} Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:36:02.583102 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. Aug 08 02:36:02.584533 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:36:02.585850 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0a91648a-0f04-4855-8725-f673fba1d3cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Returning 404 to user: Instance c7c1eeb6-26c2-4706-8b39-0f233449617a could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:36:02.585850 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0a91648a-0f04-4855-8725-f673fba1d3cc tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a" status: 404 len: 111 microversion: 2.1 time: 0.030546 Aug 08 02:36:02.585850 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 478/940] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:02 2022] GET /compute/v2.1/servers/c7c1eeb6-26c2-4706-8b39-0f233449617a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:36:02.640986 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bf2b609a-647c-4e65-9ab9-9c09fffee10f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:02.641583 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bf2b609a-647c-4e65-9ab9-9c09fffee10f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:02.649708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf2b609a-647c-4e65-9ab9-9c09fffee10f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:02.650192 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf2b609a-647c-4e65-9ab9-9c09fffee10f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:02.650648 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf2b609a-647c-4e65-9ab9-9c09fffee10f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:02.651337 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf2b609a-647c-4e65-9ab9-9c09fffee10f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:02.651782 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf2b609a-647c-4e65-9ab9-9c09fffee10f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:02.652205 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf2b609a-647c-4e65-9ab9-9c09fffee10f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:02.675189 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-bf2b609a-647c-4e65-9ab9-9c09fffee10f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lazy-loading 'flavor' on Instance uuid 614b1928-9870-453b-8bf7-7b21f36ed2be {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:36:02.847761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bf2b609a-647c-4e65-9ab9-9c09fffee10f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "POST /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/action" status: 202 len: 0 microversion: 2.20 time: 0.210548 Aug 08 02:36:02.848353 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 463/941] 10.222.0.39 () {62 vars in 1319 bytes} [Mon Aug 8 02:36:02 2022] POST /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:36:02.856637 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a9a3c5b1-302a-445f-b7b6-6c2cfcb1b21f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:02.857247 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a9a3c5b1-302a-445f-b7b6-6c2cfcb1b21f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:02.863183 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9a3c5b1-302a-445f-b7b6-6c2cfcb1b21f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:02.863658 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9a3c5b1-302a-445f-b7b6-6c2cfcb1b21f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:02.864084 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9a3c5b1-302a-445f-b7b6-6c2cfcb1b21f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:02.864790 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9a3c5b1-302a-445f-b7b6-6c2cfcb1b21f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:02.865234 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9a3c5b1-302a-445f-b7b6-6c2cfcb1b21f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:02.865645 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a9a3c5b1-302a-445f-b7b6-6c2cfcb1b21f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:03.000297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a9a3c5b1-302a-445f-b7b6-6c2cfcb1b21f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:03.009214 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a9a3c5b1-302a-445f-b7b6-6c2cfcb1b21f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:03.010742 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a9a3c5b1-302a-445f-b7b6-6c2cfcb1b21f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:03.011890 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a9a3c5b1-302a-445f-b7b6-6c2cfcb1b21f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.159133 Aug 08 02:36:03.012450 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 479/942] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:02 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:03.718169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9cecb5dd-800a-48dc-b449-dc7918324613 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:03.718784 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9cecb5dd-800a-48dc-b449-dc7918324613 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:03.725435 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cecb5dd-800a-48dc-b449-dc7918324613 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:03.725911 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cecb5dd-800a-48dc-b449-dc7918324613 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:03.726377 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cecb5dd-800a-48dc-b449-dc7918324613 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:03.727060 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cecb5dd-800a-48dc-b449-dc7918324613 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:03.727506 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cecb5dd-800a-48dc-b449-dc7918324613 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:03.727918 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cecb5dd-800a-48dc-b449-dc7918324613 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:03.741772 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-9cecb5dd-800a-48dc-b449-dc7918324613 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] HTTP exception thrown: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9cecb5dd-800a-48dc-b449-dc7918324613 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Request method failure captured: Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 HTTP/1.1 Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQg6mzkESqN9A5oZoJ_yeaR8QfkHsuvn7Gnn2Of1q2nwdQWnQJsPQf7qgT1Axr81h4HAPGOPgqHfOOvS3gMsBaNHu9AkrckqNK2QaYCwUHVJESFMZ0zfM2kScAxe3rDA_c-SQ_zKz8JbK3skckXwUZSe3rHR_eIsjUX7TcWIxReByQ Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 9ae7098cc9f24d9dbc4695789c5b87b4 Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:36:03.743410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:36:03.744960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ae7098cc9f24d9dbc4695789c5b87b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ae7098cc9f24d9dbc4695789c5b87b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ae7098cc9f24d9dbc4695789c5b87b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ae7098cc9f24d9dbc4695789c5b87b4"}]}] Aug 08 02:36:03.744960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:36:03.744960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 9ae7098cc9f24d9dbc4695789c5b87b4 Aug 08 02:36:03.744960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:36:03.744960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeTestJSON-603930406-project Aug 08 02:36:03.744960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:36:03.744960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:36:03.744960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 17286ff2e1764ec7b91e6274c7162437 Aug 08 02:36:03.744960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeTestJSON-603930406-project Aug 08 02:36:03.744960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:36:03.744960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:36:03.744960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '2a61fcac-cea3-4e95-a463-bb2f44b28e39'} Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:36:03.745959 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:36:03.747430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:36:03.748872 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9cecb5dd-800a-48dc-b449-dc7918324613 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Returning 404 to user: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:36:03.748872 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9cecb5dd-800a-48dc-b449-dc7918324613 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 404 len: 111 microversion: 2.1 time: 0.031287 Aug 08 02:36:03.748872 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 464/943] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:36:03 2022] DELETE /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:36:03.752913 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9583aa81-108b-4ea7-9c3b-fff74ac53b35 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:03.753527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9583aa81-108b-4ea7-9c3b-fff74ac53b35 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] [instance: 2a61fcac-cea3-4e95-a463-bb2f44b28e39] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:03.759942 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9583aa81-108b-4ea7-9c3b-fff74ac53b35 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:03.760430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9583aa81-108b-4ea7-9c3b-fff74ac53b35 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:03.760860 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9583aa81-108b-4ea7-9c3b-fff74ac53b35 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:03.761540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9583aa81-108b-4ea7-9c3b-fff74ac53b35 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:03.761990 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9583aa81-108b-4ea7-9c3b-fff74ac53b35 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:03.762439 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9583aa81-108b-4ea7-9c3b-fff74ac53b35 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:03.775430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-9583aa81-108b-4ea7-9c3b-fff74ac53b35 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] HTTP exception thrown: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9583aa81-108b-4ea7-9c3b-fff74ac53b35 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Request method failure captured: Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 HTTP/1.1 Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQg6mzkESqN9A5oZoJ_yeaR8QfkHsuvn7Gnn2Of1q2nwdQWnQJsPQf7qgT1Axr81h4HAPGOPgqHfOOvS3gMsBaNHu9AkrckqNK2QaYCwUHVJESFMZ0zfM2kScAxe3rDA_c-SQ_zKz8JbK3skckXwUZSe3rHR_eIsjUX7TcWIxReByQ Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 9ae7098cc9f24d9dbc4695789c5b87b4 Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:36:03.776917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:36:03.778459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ae7098cc9f24d9dbc4695789c5b87b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ae7098cc9f24d9dbc4695789c5b87b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ae7098cc9f24d9dbc4695789c5b87b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ae7098cc9f24d9dbc4695789c5b87b4"}]}] Aug 08 02:36:03.778459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:36:03.778459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 9ae7098cc9f24d9dbc4695789c5b87b4 Aug 08 02:36:03.778459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-603930406 Aug 08 02:36:03.778459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeTestJSON-603930406-project Aug 08 02:36:03.778459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:36:03.778459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:36:03.778459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 17286ff2e1764ec7b91e6274c7162437 Aug 08 02:36:03.778459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeTestJSON-603930406-project Aug 08 02:36:03.778459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:36:03.778459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:36:03.778459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '2a61fcac-cea3-4e95-a463-bb2f44b28e39'} Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:36:03.779430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. Aug 08 02:36:03.780905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:36:03.782311 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9583aa81-108b-4ea7-9c3b-fff74ac53b35 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] Returning 404 to user: Instance 2a61fcac-cea3-4e95-a463-bb2f44b28e39 could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:36:03.782311 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9583aa81-108b-4ea7-9c3b-fff74ac53b35 tempest-AttachVolumeTestJSON-603930406 tempest-AttachVolumeTestJSON-603930406-project] 10.222.0.39 "GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39" status: 404 len: 111 microversion: 2.1 time: 0.029224 Aug 08 02:36:03.782311 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 480/944] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:36:03 2022] GET /compute/v2.1/servers/2a61fcac-cea3-4e95-a463-bb2f44b28e39 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:36:04.036014 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5c36aad5-3fd3-4705-8275-b506921a0627 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:04.036628 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5c36aad5-3fd3-4705-8275-b506921a0627 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:04.042550 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c36aad5-3fd3-4705-8275-b506921a0627 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:04.043031 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c36aad5-3fd3-4705-8275-b506921a0627 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:04.043462 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c36aad5-3fd3-4705-8275-b506921a0627 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:04.044153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c36aad5-3fd3-4705-8275-b506921a0627 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:04.044724 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c36aad5-3fd3-4705-8275-b506921a0627 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:04.045148 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c36aad5-3fd3-4705-8275-b506921a0627 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:04.177143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5c36aad5-3fd3-4705-8275-b506921a0627 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:04.185162 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5c36aad5-3fd3-4705-8275-b506921a0627 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:04.186691 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5c36aad5-3fd3-4705-8275-b506921a0627 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:04.187844 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5c36aad5-3fd3-4705-8275-b506921a0627 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.156332 Aug 08 02:36:04.188598 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 465/945] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:04 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:05.220472 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d7a63581-863d-46cc-b787-d3a51532f8f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:05.221093 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d7a63581-863d-46cc-b787-d3a51532f8f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:05.228478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d7a63581-863d-46cc-b787-d3a51532f8f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:05.228976 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d7a63581-863d-46cc-b787-d3a51532f8f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:05.229394 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d7a63581-863d-46cc-b787-d3a51532f8f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:05.230267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d7a63581-863d-46cc-b787-d3a51532f8f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:05.230721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d7a63581-863d-46cc-b787-d3a51532f8f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:05.231141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d7a63581-863d-46cc-b787-d3a51532f8f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:05.470321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d7a63581-863d-46cc-b787-d3a51532f8f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:05.479199 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d7a63581-863d-46cc-b787-d3a51532f8f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:05.480781 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d7a63581-863d-46cc-b787-d3a51532f8f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:05.482056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d7a63581-863d-46cc-b787-d3a51532f8f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.274544 Aug 08 02:36:05.482829 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 481/946] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:05 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:06.506862 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8b9223dc-4b17-4cb2-85e2-c55c8ab37ca5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:06.507479 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8b9223dc-4b17-4cb2-85e2-c55c8ab37ca5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:06.514339 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b9223dc-4b17-4cb2-85e2-c55c8ab37ca5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:06.514764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b9223dc-4b17-4cb2-85e2-c55c8ab37ca5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:06.516572 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b9223dc-4b17-4cb2-85e2-c55c8ab37ca5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:06.517308 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b9223dc-4b17-4cb2-85e2-c55c8ab37ca5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:06.517765 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b9223dc-4b17-4cb2-85e2-c55c8ab37ca5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:06.518607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b9223dc-4b17-4cb2-85e2-c55c8ab37ca5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:06.744970 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b9223dc-4b17-4cb2-85e2-c55c8ab37ca5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:06.749713 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b9223dc-4b17-4cb2-85e2-c55c8ab37ca5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:06.751237 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b9223dc-4b17-4cb2-85e2-c55c8ab37ca5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:06.752671 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8b9223dc-4b17-4cb2-85e2-c55c8ab37ca5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.250228 Aug 08 02:36:06.753487 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 466/947] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:06 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:07.775256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dfffb7f5-5668-40c2-81b5-fc2656fde1ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:07.775866 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-dfffb7f5-5668-40c2-81b5-fc2656fde1ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:07.782277 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfffb7f5-5668-40c2-81b5-fc2656fde1ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:07.782763 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfffb7f5-5668-40c2-81b5-fc2656fde1ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:07.783191 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfffb7f5-5668-40c2-81b5-fc2656fde1ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:07.783875 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfffb7f5-5668-40c2-81b5-fc2656fde1ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:07.784392 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfffb7f5-5668-40c2-81b5-fc2656fde1ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:07.784817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfffb7f5-5668-40c2-81b5-fc2656fde1ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:07.920139 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-dfffb7f5-5668-40c2-81b5-fc2656fde1ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:07.928549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-dfffb7f5-5668-40c2-81b5-fc2656fde1ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:07.932189 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-dfffb7f5-5668-40c2-81b5-fc2656fde1ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:07.932189 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-dfffb7f5-5668-40c2-81b5-fc2656fde1ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.159973 Aug 08 02:36:07.932189 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 482/948] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:07 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:08.954998 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dced743f-e2bf-456d-a17a-9ad2d9a57fcc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:08.955622 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dced743f-e2bf-456d-a17a-9ad2d9a57fcc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:08.966965 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dced743f-e2bf-456d-a17a-9ad2d9a57fcc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:08.967454 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dced743f-e2bf-456d-a17a-9ad2d9a57fcc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:08.967898 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dced743f-e2bf-456d-a17a-9ad2d9a57fcc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:08.968592 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dced743f-e2bf-456d-a17a-9ad2d9a57fcc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:08.969044 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dced743f-e2bf-456d-a17a-9ad2d9a57fcc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:08.969469 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dced743f-e2bf-456d-a17a-9ad2d9a57fcc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:09.110960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dced743f-e2bf-456d-a17a-9ad2d9a57fcc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:09.119586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dced743f-e2bf-456d-a17a-9ad2d9a57fcc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:09.121191 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dced743f-e2bf-456d-a17a-9ad2d9a57fcc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:09.122675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dced743f-e2bf-456d-a17a-9ad2d9a57fcc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.171569 Aug 08 02:36:09.124020 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 467/949] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:08 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:10.148006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-872256d6-c189-4585-aeaa-bb93f5f4d491 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:10.148685 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-872256d6-c189-4585-aeaa-bb93f5f4d491 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:10.152173 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:10.156683 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-872256d6-c189-4585-aeaa-bb93f5f4d491 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:10.157167 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-872256d6-c189-4585-aeaa-bb93f5f4d491 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:10.157604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-872256d6-c189-4585-aeaa-bb93f5f4d491 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:10.158334 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-872256d6-c189-4585-aeaa-bb93f5f4d491 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:10.158816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-872256d6-c189-4585-aeaa-bb93f5f4d491 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:10.159240 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-872256d6-c189-4585-aeaa-bb93f5f4d491 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:10.165232 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:10.342149 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-872256d6-c189-4585-aeaa-bb93f5f4d491 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:10.351811 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-872256d6-c189-4585-aeaa-bb93f5f4d491 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:10.353596 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-872256d6-c189-4585-aeaa-bb93f5f4d491 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:10.354836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-872256d6-c189-4585-aeaa-bb93f5f4d491 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.211301 Aug 08 02:36:10.355565 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 483/950] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:10 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:11.376754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f2035869-e458-4eb4-8f02-2c412b15e22a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:11.380933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f2035869-e458-4eb4-8f02-2c412b15e22a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:11.384659 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2035869-e458-4eb4-8f02-2c412b15e22a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:11.385148 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2035869-e458-4eb4-8f02-2c412b15e22a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:11.385577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2035869-e458-4eb4-8f02-2c412b15e22a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:11.386292 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2035869-e458-4eb4-8f02-2c412b15e22a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:11.386747 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2035869-e458-4eb4-8f02-2c412b15e22a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:11.387166 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2035869-e458-4eb4-8f02-2c412b15e22a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:11.521305 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f2035869-e458-4eb4-8f02-2c412b15e22a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:11.529119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f2035869-e458-4eb4-8f02-2c412b15e22a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:11.530645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f2035869-e458-4eb4-8f02-2c412b15e22a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:11.531783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f2035869-e458-4eb4-8f02-2c412b15e22a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.158901 Aug 08 02:36:11.532333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 468/951] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:11 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:12.553968 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-00a2e289-7f9e-4227-acb4-06e376f3060f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:12.554596 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-00a2e289-7f9e-4227-acb4-06e376f3060f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:12.560925 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-00a2e289-7f9e-4227-acb4-06e376f3060f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:12.561394 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-00a2e289-7f9e-4227-acb4-06e376f3060f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:12.561818 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-00a2e289-7f9e-4227-acb4-06e376f3060f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:12.562522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-00a2e289-7f9e-4227-acb4-06e376f3060f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:12.562964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-00a2e289-7f9e-4227-acb4-06e376f3060f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:12.563378 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-00a2e289-7f9e-4227-acb4-06e376f3060f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:12.690367 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-00a2e289-7f9e-4227-acb4-06e376f3060f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:12.698593 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-00a2e289-7f9e-4227-acb4-06e376f3060f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:12.700074 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-00a2e289-7f9e-4227-acb4-06e376f3060f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:12.701206 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-00a2e289-7f9e-4227-acb4-06e376f3060f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.151101 Aug 08 02:36:12.701759 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 484/952] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:12 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:13.725397 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3061259e-20a9-4133-b9ad-f4d839b81e4a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:13.725946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3061259e-20a9-4133-b9ad-f4d839b81e4a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:13.732071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3061259e-20a9-4133-b9ad-f4d839b81e4a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:13.732560 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3061259e-20a9-4133-b9ad-f4d839b81e4a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:13.733005 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3061259e-20a9-4133-b9ad-f4d839b81e4a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:13.733701 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3061259e-20a9-4133-b9ad-f4d839b81e4a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:13.734161 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3061259e-20a9-4133-b9ad-f4d839b81e4a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:13.734613 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3061259e-20a9-4133-b9ad-f4d839b81e4a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:13.864218 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3061259e-20a9-4133-b9ad-f4d839b81e4a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:13.872156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3061259e-20a9-4133-b9ad-f4d839b81e4a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:13.873678 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3061259e-20a9-4133-b9ad-f4d839b81e4a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:13.874870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3061259e-20a9-4133-b9ad-f4d839b81e4a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.154226 Aug 08 02:36:13.875439 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 469/953] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:13 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:14.897865 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a7be01b8-b6e5-4e72-a861-e411a4f2e4f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:14.899106 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a7be01b8-b6e5-4e72-a861-e411a4f2e4f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:14.905370 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a7be01b8-b6e5-4e72-a861-e411a4f2e4f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:14.905838 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a7be01b8-b6e5-4e72-a861-e411a4f2e4f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:14.906285 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a7be01b8-b6e5-4e72-a861-e411a4f2e4f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:14.907035 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a7be01b8-b6e5-4e72-a861-e411a4f2e4f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:14.907477 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a7be01b8-b6e5-4e72-a861-e411a4f2e4f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:14.907888 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a7be01b8-b6e5-4e72-a861-e411a4f2e4f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:15.038392 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a7be01b8-b6e5-4e72-a861-e411a4f2e4f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:15.046350 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a7be01b8-b6e5-4e72-a861-e411a4f2e4f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:15.047847 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a7be01b8-b6e5-4e72-a861-e411a4f2e4f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:15.048989 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a7be01b8-b6e5-4e72-a861-e411a4f2e4f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.155374 Aug 08 02:36:15.049545 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 485/954] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:14 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:16.072377 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9d25568c-a04c-4325-97d3-e5453066b232 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:16.072993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9d25568c-a04c-4325-97d3-e5453066b232 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:16.079588 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d25568c-a04c-4325-97d3-e5453066b232 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:16.080076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d25568c-a04c-4325-97d3-e5453066b232 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:16.080509 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d25568c-a04c-4325-97d3-e5453066b232 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:16.081214 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d25568c-a04c-4325-97d3-e5453066b232 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:16.081702 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d25568c-a04c-4325-97d3-e5453066b232 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:16.082148 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9d25568c-a04c-4325-97d3-e5453066b232 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:16.211962 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9d25568c-a04c-4325-97d3-e5453066b232 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:16.220117 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9d25568c-a04c-4325-97d3-e5453066b232 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:16.221626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9d25568c-a04c-4325-97d3-e5453066b232 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:16.222808 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9d25568c-a04c-4325-97d3-e5453066b232 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1744 microversion: 2.20 time: 0.154421 Aug 08 02:36:16.223369 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 470/955] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:16 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:17.246622 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d26e9b91-8173-4f61-b2b3-b770607cf0ed tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:17.247165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d26e9b91-8173-4f61-b2b3-b770607cf0ed tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:17.254056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d26e9b91-8173-4f61-b2b3-b770607cf0ed tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:17.254564 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d26e9b91-8173-4f61-b2b3-b770607cf0ed tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:17.254998 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d26e9b91-8173-4f61-b2b3-b770607cf0ed tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:17.255677 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d26e9b91-8173-4f61-b2b3-b770607cf0ed tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:17.256131 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d26e9b91-8173-4f61-b2b3-b770607cf0ed tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:17.256549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d26e9b91-8173-4f61-b2b3-b770607cf0ed tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:17.384750 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d26e9b91-8173-4f61-b2b3-b770607cf0ed tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:17.392694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d26e9b91-8173-4f61-b2b3-b770607cf0ed tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:17.394779 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d26e9b91-8173-4f61-b2b3-b770607cf0ed tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:17.395927 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d26e9b91-8173-4f61-b2b3-b770607cf0ed tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1744 microversion: 2.20 time: 0.153326 Aug 08 02:36:17.396474 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 486/956] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:17 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:18.418795 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6c65cbea-c445-44fc-9fb6-5d507c8a2645 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:18.419340 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6c65cbea-c445-44fc-9fb6-5d507c8a2645 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:18.425790 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c65cbea-c445-44fc-9fb6-5d507c8a2645 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:18.426310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c65cbea-c445-44fc-9fb6-5d507c8a2645 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:18.426753 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c65cbea-c445-44fc-9fb6-5d507c8a2645 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:18.427448 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c65cbea-c445-44fc-9fb6-5d507c8a2645 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:18.427904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c65cbea-c445-44fc-9fb6-5d507c8a2645 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:18.428333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c65cbea-c445-44fc-9fb6-5d507c8a2645 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:18.557051 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6c65cbea-c445-44fc-9fb6-5d507c8a2645 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:18.564897 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6c65cbea-c445-44fc-9fb6-5d507c8a2645 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:18.567210 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6c65cbea-c445-44fc-9fb6-5d507c8a2645 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:18.568355 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6c65cbea-c445-44fc-9fb6-5d507c8a2645 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1744 microversion: 2.20 time: 0.153640 Aug 08 02:36:18.568911 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 471/957] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:18 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:19.591311 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e7c214ba-c33c-44f7-b3f7-e4e0770af45a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:19.591914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e7c214ba-c33c-44f7-b3f7-e4e0770af45a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:19.598501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7c214ba-c33c-44f7-b3f7-e4e0770af45a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:19.598973 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7c214ba-c33c-44f7-b3f7-e4e0770af45a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:19.599438 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7c214ba-c33c-44f7-b3f7-e4e0770af45a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:19.600113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7c214ba-c33c-44f7-b3f7-e4e0770af45a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:19.600557 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7c214ba-c33c-44f7-b3f7-e4e0770af45a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:19.601000 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e7c214ba-c33c-44f7-b3f7-e4e0770af45a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:19.729161 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e7c214ba-c33c-44f7-b3f7-e4e0770af45a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:19.737069 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e7c214ba-c33c-44f7-b3f7-e4e0770af45a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:19.739094 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e7c214ba-c33c-44f7-b3f7-e4e0770af45a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:19.740243 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e7c214ba-c33c-44f7-b3f7-e4e0770af45a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1744 microversion: 2.20 time: 0.152876 Aug 08 02:36:19.740786 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 487/958] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:19 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:20.764230 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-706fd8b6-8f91-4c26-9266-82db22b6f90c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:20.764850 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-706fd8b6-8f91-4c26-9266-82db22b6f90c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:20.771787 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-706fd8b6-8f91-4c26-9266-82db22b6f90c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:20.772270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-706fd8b6-8f91-4c26-9266-82db22b6f90c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:20.772710 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-706fd8b6-8f91-4c26-9266-82db22b6f90c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:20.773400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-706fd8b6-8f91-4c26-9266-82db22b6f90c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:20.773856 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-706fd8b6-8f91-4c26-9266-82db22b6f90c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:20.774308 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-706fd8b6-8f91-4c26-9266-82db22b6f90c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:20.905961 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-706fd8b6-8f91-4c26-9266-82db22b6f90c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:20.913820 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-706fd8b6-8f91-4c26-9266-82db22b6f90c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:20.915347 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-706fd8b6-8f91-4c26-9266-82db22b6f90c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:20.916501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-706fd8b6-8f91-4c26-9266-82db22b6f90c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1744 microversion: 2.20 time: 0.156159 Aug 08 02:36:20.917057 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 472/959] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:20 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:21.940321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3d4d0674-066e-44e5-8b00-7ebb06a7a702 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:21.940852 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3d4d0674-066e-44e5-8b00-7ebb06a7a702 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:21.947175 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3d4d0674-066e-44e5-8b00-7ebb06a7a702 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:21.947652 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3d4d0674-066e-44e5-8b00-7ebb06a7a702 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:21.948075 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3d4d0674-066e-44e5-8b00-7ebb06a7a702 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:21.948744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3d4d0674-066e-44e5-8b00-7ebb06a7a702 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:21.949186 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3d4d0674-066e-44e5-8b00-7ebb06a7a702 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:21.949598 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3d4d0674-066e-44e5-8b00-7ebb06a7a702 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:22.077423 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3d4d0674-066e-44e5-8b00-7ebb06a7a702 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:22.085959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3d4d0674-066e-44e5-8b00-7ebb06a7a702 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:22.087503 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3d4d0674-066e-44e5-8b00-7ebb06a7a702 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:22.088684 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3d4d0674-066e-44e5-8b00-7ebb06a7a702 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1744 microversion: 2.20 time: 0.152618 Aug 08 02:36:22.089254 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 488/960] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:21 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:23.111978 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1c27b85d-0ab3-49bc-a229-efd4fbef44f8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:23.113176 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1c27b85d-0ab3-49bc-a229-efd4fbef44f8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:23.119608 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c27b85d-0ab3-49bc-a229-efd4fbef44f8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:23.120095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c27b85d-0ab3-49bc-a229-efd4fbef44f8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:23.120532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c27b85d-0ab3-49bc-a229-efd4fbef44f8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:23.121214 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c27b85d-0ab3-49bc-a229-efd4fbef44f8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:23.121667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c27b85d-0ab3-49bc-a229-efd4fbef44f8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:23.122092 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c27b85d-0ab3-49bc-a229-efd4fbef44f8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:23.248233 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1c27b85d-0ab3-49bc-a229-efd4fbef44f8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:23.256077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1c27b85d-0ab3-49bc-a229-efd4fbef44f8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:23.257590 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1c27b85d-0ab3-49bc-a229-efd4fbef44f8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:23.258775 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1c27b85d-0ab3-49bc-a229-efd4fbef44f8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1744 microversion: 2.20 time: 0.150721 Aug 08 02:36:23.259329 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 473/961] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:23 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:24.216164 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-e8d89b61-142c-43d2-bd6b-ab1e73ea1265 req-526dc30f-3b5f-42ba-9b64-3535e22c6cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614b1928-9870-453b-8bf7-7b21f36ed2be", "name": "network-vif-plugged", "status": "completed", "tag": "2d321e72-03cd-4396-9683-df053c6107d1"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:24.225558 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-e8d89b61-142c-43d2-bd6b-ab1e73ea1265 req-526dc30f-3b5f-42ba-9b64-3535e22c6cb8 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:24.225963 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-e8d89b61-142c-43d2-bd6b-ab1e73ea1265 req-526dc30f-3b5f-42ba-9b64-3535e22c6cb8 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:24.226410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-e8d89b61-142c-43d2-bd6b-ab1e73ea1265 req-526dc30f-3b5f-42ba-9b64-3535e22c6cb8 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:24.237157 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-e8d89b61-142c-43d2-bd6b-ab1e73ea1265 req-526dc30f-3b5f-42ba-9b64-3535e22c6cb8 service nova] Creating event network-vif-plugged:2d321e72-03cd-4396-9683-df053c6107d1 for instance 614b1928-9870-453b-8bf7-7b21f36ed2be on hv-cinder-73306 Aug 08 02:36:24.242983 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-e8d89b61-142c-43d2-bd6b-ab1e73ea1265 req-526dc30f-3b5f-42ba-9b64-3535e22c6cb8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162856 Aug 08 02:36:24.243342 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 489/962] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:36:24.280803 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e09761e3-504b-4829-9fe2-2bf305cae035 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:24.281505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e09761e3-504b-4829-9fe2-2bf305cae035 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:24.288197 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e09761e3-504b-4829-9fe2-2bf305cae035 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:24.288679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e09761e3-504b-4829-9fe2-2bf305cae035 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:24.289115 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e09761e3-504b-4829-9fe2-2bf305cae035 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:24.289809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e09761e3-504b-4829-9fe2-2bf305cae035 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:24.290282 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e09761e3-504b-4829-9fe2-2bf305cae035 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:24.290712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e09761e3-504b-4829-9fe2-2bf305cae035 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:24.429207 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e09761e3-504b-4829-9fe2-2bf305cae035 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:24.438466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e09761e3-504b-4829-9fe2-2bf305cae035 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:24.440404 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e09761e3-504b-4829-9fe2-2bf305cae035 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:24.442462 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e09761e3-504b-4829-9fe2-2bf305cae035 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1739 microversion: 2.20 time: 0.165591 Aug 08 02:36:24.458703 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 474/963] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:24 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:25.467109 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-692688c3-b2d3-4774-b610-6a9e82ded230 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:25.468489 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-692688c3-b2d3-4774-b610-6a9e82ded230 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:25.476043 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-692688c3-b2d3-4774-b610-6a9e82ded230 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:25.476671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-692688c3-b2d3-4774-b610-6a9e82ded230 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:25.477325 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-692688c3-b2d3-4774-b610-6a9e82ded230 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:25.478295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-692688c3-b2d3-4774-b610-6a9e82ded230 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:25.479009 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-692688c3-b2d3-4774-b610-6a9e82ded230 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:25.479649 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-692688c3-b2d3-4774-b610-6a9e82ded230 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:25.627963 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-692688c3-b2d3-4774-b610-6a9e82ded230 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:25.636819 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-692688c3-b2d3-4774-b610-6a9e82ded230 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:25.638553 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-692688c3-b2d3-4774-b610-6a9e82ded230 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:25.639933 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-692688c3-b2d3-4774-b610-6a9e82ded230 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1739 microversion: 2.20 time: 0.177492 Aug 08 02:36:25.640641 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 490/964] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:25 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:26.663256 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-29ec2314-5008-42d2-90aa-510cdb3a5457 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:26.664464 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-29ec2314-5008-42d2-90aa-510cdb3a5457 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:26.671094 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-29ec2314-5008-42d2-90aa-510cdb3a5457 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:26.671821 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-29ec2314-5008-42d2-90aa-510cdb3a5457 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:26.672261 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-29ec2314-5008-42d2-90aa-510cdb3a5457 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:26.672967 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-29ec2314-5008-42d2-90aa-510cdb3a5457 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:26.673425 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-29ec2314-5008-42d2-90aa-510cdb3a5457 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:26.673856 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-29ec2314-5008-42d2-90aa-510cdb3a5457 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:26.846618 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-29ec2314-5008-42d2-90aa-510cdb3a5457 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:26.859083 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-29ec2314-5008-42d2-90aa-510cdb3a5457 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:26.861063 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-29ec2314-5008-42d2-90aa-510cdb3a5457 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:26.864062 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-29ec2314-5008-42d2-90aa-510cdb3a5457 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1739 microversion: 2.20 time: 0.205040 Aug 08 02:36:26.882521 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 475/965] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:26 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:27.888935 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-446aa06f-3c8c-41f9-bdac-abc06a442370 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:27.889549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-446aa06f-3c8c-41f9-bdac-abc06a442370 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:27.900012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-446aa06f-3c8c-41f9-bdac-abc06a442370 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:27.900520 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-446aa06f-3c8c-41f9-bdac-abc06a442370 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:27.901002 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-446aa06f-3c8c-41f9-bdac-abc06a442370 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:27.901727 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-446aa06f-3c8c-41f9-bdac-abc06a442370 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:27.902340 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-446aa06f-3c8c-41f9-bdac-abc06a442370 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:27.902808 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-446aa06f-3c8c-41f9-bdac-abc06a442370 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:28.053890 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-446aa06f-3c8c-41f9-bdac-abc06a442370 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:28.068034 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-446aa06f-3c8c-41f9-bdac-abc06a442370 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:28.071895 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-446aa06f-3c8c-41f9-bdac-abc06a442370 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:28.073383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-446aa06f-3c8c-41f9-bdac-abc06a442370 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1739 microversion: 2.20 time: 0.188087 Aug 08 02:36:28.074150 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 491/966] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:27 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:29.095660 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-90497af6-6ba2-498d-8286-f119ca90f8b8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:29.096697 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-90497af6-6ba2-498d-8286-f119ca90f8b8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:29.111763 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90497af6-6ba2-498d-8286-f119ca90f8b8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:29.112261 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90497af6-6ba2-498d-8286-f119ca90f8b8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:29.112808 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90497af6-6ba2-498d-8286-f119ca90f8b8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:29.113582 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90497af6-6ba2-498d-8286-f119ca90f8b8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:29.114073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90497af6-6ba2-498d-8286-f119ca90f8b8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:29.114673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90497af6-6ba2-498d-8286-f119ca90f8b8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:29.280643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-90497af6-6ba2-498d-8286-f119ca90f8b8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:29.289630 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-90497af6-6ba2-498d-8286-f119ca90f8b8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:29.291982 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-90497af6-6ba2-498d-8286-f119ca90f8b8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:29.293408 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-90497af6-6ba2-498d-8286-f119ca90f8b8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1739 microversion: 2.20 time: 0.201933 Aug 08 02:36:29.307241 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 476/967] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:29 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:30.318342 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ce521044-6b04-462c-97f4-a6db578eb2ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:30.318948 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ce521044-6b04-462c-97f4-a6db578eb2ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:30.325897 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ce521044-6b04-462c-97f4-a6db578eb2ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:30.326682 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ce521044-6b04-462c-97f4-a6db578eb2ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:30.327496 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ce521044-6b04-462c-97f4-a6db578eb2ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:30.334208 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ce521044-6b04-462c-97f4-a6db578eb2ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:30.335739 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ce521044-6b04-462c-97f4-a6db578eb2ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:30.336176 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ce521044-6b04-462c-97f4-a6db578eb2ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:30.520080 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ce521044-6b04-462c-97f4-a6db578eb2ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:30.531632 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ce521044-6b04-462c-97f4-a6db578eb2ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:30.535463 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ce521044-6b04-462c-97f4-a6db578eb2ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:30.537694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ce521044-6b04-462c-97f4-a6db578eb2ab tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1739 microversion: 2.20 time: 0.223834 Aug 08 02:36:30.538829 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 492/968] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:30 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:31.566181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d3caa065-bf52-46e3-b93e-fb23e59278f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:31.566848 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d3caa065-bf52-46e3-b93e-fb23e59278f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:31.573660 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3caa065-bf52-46e3-b93e-fb23e59278f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:31.574420 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3caa065-bf52-46e3-b93e-fb23e59278f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:31.575014 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3caa065-bf52-46e3-b93e-fb23e59278f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:31.575871 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3caa065-bf52-46e3-b93e-fb23e59278f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:31.576502 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3caa065-bf52-46e3-b93e-fb23e59278f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:31.577092 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3caa065-bf52-46e3-b93e-fb23e59278f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:31.725946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d3caa065-bf52-46e3-b93e-fb23e59278f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:31.734550 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d3caa065-bf52-46e3-b93e-fb23e59278f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:31.736245 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d3caa065-bf52-46e3-b93e-fb23e59278f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:31.738163 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d3caa065-bf52-46e3-b93e-fb23e59278f7 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1739 microversion: 2.20 time: 0.177170 Aug 08 02:36:31.738950 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 477/969] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:31 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:32.761576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5a8f48e2-ea6b-45d6-aa6b-3df3b83a28df tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:32.762873 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5a8f48e2-ea6b-45d6-aa6b-3df3b83a28df tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:32.771246 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a8f48e2-ea6b-45d6-aa6b-3df3b83a28df tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:32.771755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a8f48e2-ea6b-45d6-aa6b-3df3b83a28df tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:32.772243 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a8f48e2-ea6b-45d6-aa6b-3df3b83a28df tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:32.772943 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a8f48e2-ea6b-45d6-aa6b-3df3b83a28df tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:32.773395 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a8f48e2-ea6b-45d6-aa6b-3df3b83a28df tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:32.774011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a8f48e2-ea6b-45d6-aa6b-3df3b83a28df tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:32.917389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5a8f48e2-ea6b-45d6-aa6b-3df3b83a28df tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:32.926923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5a8f48e2-ea6b-45d6-aa6b-3df3b83a28df tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:32.928435 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5a8f48e2-ea6b-45d6-aa6b-3df3b83a28df tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:32.929806 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5a8f48e2-ea6b-45d6-aa6b-3df3b83a28df tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1739 microversion: 2.20 time: 0.172306 Aug 08 02:36:32.930553 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 493/970] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:32 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:33.957120 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-10c9b9f9-0dce-4f86-8a5f-faf6b0fe8b66 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:33.957854 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-10c9b9f9-0dce-4f86-8a5f-faf6b0fe8b66 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:33.961713 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=32 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:33.965235 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10c9b9f9-0dce-4f86-8a5f-faf6b0fe8b66 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:33.965943 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10c9b9f9-0dce-4f86-8a5f-faf6b0fe8b66 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:33.966557 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10c9b9f9-0dce-4f86-8a5f-faf6b0fe8b66 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:33.967414 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10c9b9f9-0dce-4f86-8a5f-faf6b0fe8b66 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:33.967992 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10c9b9f9-0dce-4f86-8a5f-faf6b0fe8b66 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:33.968418 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10c9b9f9-0dce-4f86-8a5f-faf6b0fe8b66 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:33.972478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:34.124628 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-10c9b9f9-0dce-4f86-8a5f-faf6b0fe8b66 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:34.133260 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-10c9b9f9-0dce-4f86-8a5f-faf6b0fe8b66 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:34.134790 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-10c9b9f9-0dce-4f86-8a5f-faf6b0fe8b66 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:34.136240 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-10c9b9f9-0dce-4f86-8a5f-faf6b0fe8b66 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1739 microversion: 2.20 time: 0.183056 Aug 08 02:36:34.136948 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 478/971] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:33 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:35.159512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8e7c15e3-ba63-46a2-8a96-b113616e37cd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:35.160285 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8e7c15e3-ba63-46a2-8a96-b113616e37cd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:35.168799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8e7c15e3-ba63-46a2-8a96-b113616e37cd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:35.169972 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8e7c15e3-ba63-46a2-8a96-b113616e37cd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:35.170949 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8e7c15e3-ba63-46a2-8a96-b113616e37cd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:35.171605 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8e7c15e3-ba63-46a2-8a96-b113616e37cd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:35.172049 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8e7c15e3-ba63-46a2-8a96-b113616e37cd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:35.172470 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8e7c15e3-ba63-46a2-8a96-b113616e37cd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:35.403009 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8e7c15e3-ba63-46a2-8a96-b113616e37cd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:35.411094 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8e7c15e3-ba63-46a2-8a96-b113616e37cd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:35.412873 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8e7c15e3-ba63-46a2-8a96-b113616e37cd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:35.414221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8e7c15e3-ba63-46a2-8a96-b113616e37cd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1721 microversion: 2.20 time: 0.258934 Aug 08 02:36:35.414959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 494/972] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:35 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:36.439384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-71421a71-1744-4947-83ff-19450bef0324 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:36.440249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-71421a71-1744-4947-83ff-19450bef0324 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:36.446827 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71421a71-1744-4947-83ff-19450bef0324 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:36.447311 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71421a71-1744-4947-83ff-19450bef0324 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:36.447747 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71421a71-1744-4947-83ff-19450bef0324 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:36.448439 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71421a71-1744-4947-83ff-19450bef0324 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:36.448898 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71421a71-1744-4947-83ff-19450bef0324 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:36.449320 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71421a71-1744-4947-83ff-19450bef0324 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:36.578758 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-71421a71-1744-4947-83ff-19450bef0324 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:36.587214 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-71421a71-1744-4947-83ff-19450bef0324 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:36.588721 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-71421a71-1744-4947-83ff-19450bef0324 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:36.589870 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-71421a71-1744-4947-83ff-19450bef0324 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1721 microversion: 2.20 time: 0.154447 Aug 08 02:36:36.590451 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 479/973] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:36 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:37.614286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-02d965f6-45d6-4e35-877b-906727ed93d2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:37.615006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-02d965f6-45d6-4e35-877b-906727ed93d2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:37.622283 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-02d965f6-45d6-4e35-877b-906727ed93d2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:37.623080 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-02d965f6-45d6-4e35-877b-906727ed93d2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:37.623581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-02d965f6-45d6-4e35-877b-906727ed93d2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:37.624719 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-02d965f6-45d6-4e35-877b-906727ed93d2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:37.625246 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-02d965f6-45d6-4e35-877b-906727ed93d2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:37.625742 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-02d965f6-45d6-4e35-877b-906727ed93d2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:37.779068 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-02d965f6-45d6-4e35-877b-906727ed93d2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:37.788979 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-02d965f6-45d6-4e35-877b-906727ed93d2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:37.790697 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-02d965f6-45d6-4e35-877b-906727ed93d2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:37.792065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-02d965f6-45d6-4e35-877b-906727ed93d2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1721 microversion: 2.20 time: 0.182854 Aug 08 02:36:37.792752 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 495/974] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:37 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:38.070875 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-064077a0-0a0d-4487-9350-ac9fc431dbad req-9ca059c9-e079-4b6a-9f42-54fab0fa264c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614b1928-9870-453b-8bf7-7b21f36ed2be", "name": "network-vif-unplugged", "status": "completed", "tag": "2d321e72-03cd-4396-9683-df053c6107d1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:38.082974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-064077a0-0a0d-4487-9350-ac9fc431dbad req-9ca059c9-e079-4b6a-9f42-54fab0fa264c service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:38.083951 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-064077a0-0a0d-4487-9350-ac9fc431dbad req-9ca059c9-e079-4b6a-9f42-54fab0fa264c service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:38.084484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-064077a0-0a0d-4487-9350-ac9fc431dbad req-9ca059c9-e079-4b6a-9f42-54fab0fa264c service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:38.099381 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.compute.server_external_events [req-064077a0-0a0d-4487-9350-ac9fc431dbad req-9ca059c9-e079-4b6a-9f42-54fab0fa264c service nova] Unable to find a host for instance 614b1928-9870-453b-8bf7-7b21f36ed2be. Dropping event network-vif-unplugged {{(pid=117642) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 08 02:36:38.101023 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-064077a0-0a0d-4487-9350-ac9fc431dbad req-9ca059c9-e079-4b6a-9f42-54fab0fa264c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034592 Aug 08 02:36:38.101794 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 480/975] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 08 02:36:38.816185 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c9ba3838-378e-42c7-8fd9-2f085d337c74 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:38.817066 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c9ba3838-378e-42c7-8fd9-2f085d337c74 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:38.824336 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c9ba3838-378e-42c7-8fd9-2f085d337c74 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:38.825133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c9ba3838-378e-42c7-8fd9-2f085d337c74 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:38.825868 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c9ba3838-378e-42c7-8fd9-2f085d337c74 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:38.826866 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c9ba3838-378e-42c7-8fd9-2f085d337c74 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:38.827404 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c9ba3838-378e-42c7-8fd9-2f085d337c74 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:38.827986 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c9ba3838-378e-42c7-8fd9-2f085d337c74 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:38.999845 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c9ba3838-378e-42c7-8fd9-2f085d337c74 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:39.007917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c9ba3838-378e-42c7-8fd9-2f085d337c74 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:39.009519 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c9ba3838-378e-42c7-8fd9-2f085d337c74 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:39.010723 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c9ba3838-378e-42c7-8fd9-2f085d337c74 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1664 microversion: 2.20 time: 0.199042 Aug 08 02:36:39.011305 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 496/976] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:38 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1664 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:39.032929 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-32b6b17a-e4c4-49bb-aa46-2f079f41182c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1034732-be37-4c58-a6ea-ff989c204e34"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:39.035779 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-32b6b17a-e4c4-49bb-aa46-2f079f41182c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:39.041592 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32b6b17a-e4c4-49bb-aa46-2f079f41182c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:39.042070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32b6b17a-e4c4-49bb-aa46-2f079f41182c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:39.042544 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32b6b17a-e4c4-49bb-aa46-2f079f41182c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:39.043236 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32b6b17a-e4c4-49bb-aa46-2f079f41182c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:39.043687 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32b6b17a-e4c4-49bb-aa46-2f079f41182c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:39.044116 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32b6b17a-e4c4-49bb-aa46-2f079f41182c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:39.349231 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-32b6b17a-e4c4-49bb-aa46-2f079f41182c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "POST /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.320252 Aug 08 02:36:39.351079 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 481/977] 10.222.0.39 () {62 vars in 1364 bytes} [Mon Aug 8 02:36:39 2022] POST /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-volume_attachments => generated 188 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:36:39.484718 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-10fa3f0b-36b3-4aa6-884d-3cada697dae1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:39.485309 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-10fa3f0b-36b3-4aa6-884d-3cada697dae1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:39.494528 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10fa3f0b-36b3-4aa6-884d-3cada697dae1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:39.495045 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10fa3f0b-36b3-4aa6-884d-3cada697dae1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:39.495478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10fa3f0b-36b3-4aa6-884d-3cada697dae1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:39.496179 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10fa3f0b-36b3-4aa6-884d-3cada697dae1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:39.496633 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10fa3f0b-36b3-4aa6-884d-3cada697dae1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:39.497056 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10fa3f0b-36b3-4aa6-884d-3cada697dae1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:39.542843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-10fa3f0b-36b3-4aa6-884d-3cada697dae1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117640) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 02:36:39.614061 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-10fa3f0b-36b3-4aa6-884d-3cada697dae1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "POST /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/action" status: 202 len: 0 microversion: 2.20 time: 0.133237 Aug 08 02:36:39.614816 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 497/978] 10.222.0.39 () {62 vars in 1319 bytes} [Mon Aug 8 02:36:39 2022] POST /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 08 02:36:39.623543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f3040d2b-e7ef-45d0-8db1-52e301941411 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:39.624279 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f3040d2b-e7ef-45d0-8db1-52e301941411 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:39.633412 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f3040d2b-e7ef-45d0-8db1-52e301941411 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:39.633900 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f3040d2b-e7ef-45d0-8db1-52e301941411 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:39.634383 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f3040d2b-e7ef-45d0-8db1-52e301941411 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:39.635089 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f3040d2b-e7ef-45d0-8db1-52e301941411 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:39.635540 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f3040d2b-e7ef-45d0-8db1-52e301941411 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:39.635956 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f3040d2b-e7ef-45d0-8db1-52e301941411 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:39.778441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f3040d2b-e7ef-45d0-8db1-52e301941411 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:39.788211 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f3040d2b-e7ef-45d0-8db1-52e301941411 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:39.789826 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f3040d2b-e7ef-45d0-8db1-52e301941411 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:39.791159 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f3040d2b-e7ef-45d0-8db1-52e301941411 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1750 microversion: 2.20 time: 0.172394 Aug 08 02:36:39.791853 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 482/979] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:39 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:40.565931 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ea25e3cd-7219-4317-a9c4-786fecc50281 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:40.566504 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ea25e3cd-7219-4317-a9c4-786fecc50281 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:40.568514 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:40.575089 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ea25e3cd-7219-4317-a9c4-786fecc50281 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:40.575575 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ea25e3cd-7219-4317-a9c4-786fecc50281 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:40.576141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ea25e3cd-7219-4317-a9c4-786fecc50281 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:40.576841 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ea25e3cd-7219-4317-a9c4-786fecc50281 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:40.577317 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ea25e3cd-7219-4317-a9c4-786fecc50281 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:40.577944 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ea25e3cd-7219-4317-a9c4-786fecc50281 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:40.583377 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:36:40.605119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ea25e3cd-7219-4317-a9c4-786fecc50281 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8/ips" status: 200 len: 151 microversion: 2.1 time: 0.043783 Aug 08 02:36:40.612436 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 498/980] 10.222.0.39 () {58 vars in 1248 bytes} [Mon Aug 8 02:36:40 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:36:40.814036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-350ddc28-fbbb-4fe9-bd8b-dc77ccf73b47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:40.814690 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-350ddc28-fbbb-4fe9-bd8b-dc77ccf73b47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:40.823097 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-350ddc28-fbbb-4fe9-bd8b-dc77ccf73b47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:40.823995 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-350ddc28-fbbb-4fe9-bd8b-dc77ccf73b47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:40.824422 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-350ddc28-fbbb-4fe9-bd8b-dc77ccf73b47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:40.825128 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-350ddc28-fbbb-4fe9-bd8b-dc77ccf73b47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:40.825935 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-350ddc28-fbbb-4fe9-bd8b-dc77ccf73b47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:40.826511 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-350ddc28-fbbb-4fe9-bd8b-dc77ccf73b47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:41.020984 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-350ddc28-fbbb-4fe9-bd8b-dc77ccf73b47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:41.031347 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-350ddc28-fbbb-4fe9-bd8b-dc77ccf73b47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:41.032867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-350ddc28-fbbb-4fe9-bd8b-dc77ccf73b47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:41.034403 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-350ddc28-fbbb-4fe9-bd8b-dc77ccf73b47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1750 microversion: 2.20 time: 0.224290 Aug 08 02:36:41.035515 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 483/981] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:40 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1750 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:36:42.037200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1055b471-8881-45a4-bac6-25248cd13a8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f822fb4-ff96-42a1-a96f-5dd79c2a4b0b"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:36:42.039895 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1055b471-8881-45a4-bac6-25248cd13a8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:42.047328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1055b471-8881-45a4-bac6-25248cd13a8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:42.047805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1055b471-8881-45a4-bac6-25248cd13a8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:42.048232 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1055b471-8881-45a4-bac6-25248cd13a8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:42.048917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1055b471-8881-45a4-bac6-25248cd13a8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:42.049425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1055b471-8881-45a4-bac6-25248cd13a8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:42.049844 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1055b471-8881-45a4-bac6-25248cd13a8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:42.056990 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-515058ba-0fab-4d56-897d-b7cf295b20c2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:42.057600 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-515058ba-0fab-4d56-897d-b7cf295b20c2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:42.064181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-515058ba-0fab-4d56-897d-b7cf295b20c2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:42.064669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-515058ba-0fab-4d56-897d-b7cf295b20c2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:42.065406 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-515058ba-0fab-4d56-897d-b7cf295b20c2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:42.066643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-515058ba-0fab-4d56-897d-b7cf295b20c2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:42.067095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-515058ba-0fab-4d56-897d-b7cf295b20c2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:42.067546 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-515058ba-0fab-4d56-897d-b7cf295b20c2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:42.210328 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-515058ba-0fab-4d56-897d-b7cf295b20c2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:42.219429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-515058ba-0fab-4d56-897d-b7cf295b20c2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:42.221206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-515058ba-0fab-4d56-897d-b7cf295b20c2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:42.222629 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-515058ba-0fab-4d56-897d-b7cf295b20c2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1752 microversion: 2.20 time: 0.169610 Aug 08 02:36:42.223693 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 484/982] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:42 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:36:42.354707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1055b471-8881-45a4-bac6-25248cd13a8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "POST /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321720 Aug 08 02:36:42.355304 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 499/983] 10.222.0.39 () {60 vars in 1323 bytes} [Mon Aug 8 02:36:42 2022] POST /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:36:43.250437 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8b1307fd-0a3a-465d-9cbf-34a4d6d29d06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:43.250972 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8b1307fd-0a3a-465d-9cbf-34a4d6d29d06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:43.256937 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b1307fd-0a3a-465d-9cbf-34a4d6d29d06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:43.257412 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b1307fd-0a3a-465d-9cbf-34a4d6d29d06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:43.257841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b1307fd-0a3a-465d-9cbf-34a4d6d29d06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:43.258555 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b1307fd-0a3a-465d-9cbf-34a4d6d29d06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:43.259003 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b1307fd-0a3a-465d-9cbf-34a4d6d29d06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:43.259418 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b1307fd-0a3a-465d-9cbf-34a4d6d29d06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:43.395057 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b1307fd-0a3a-465d-9cbf-34a4d6d29d06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:43.403948 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b1307fd-0a3a-465d-9cbf-34a4d6d29d06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:43.405445 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b1307fd-0a3a-465d-9cbf-34a4d6d29d06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:43.406655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8b1307fd-0a3a-465d-9cbf-34a4d6d29d06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.160327 Aug 08 02:36:43.422272 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 485/984] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:43 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:44.435975 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4ce6f043-1872-49f8-9a4c-3b0823621d0e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:44.436672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4ce6f043-1872-49f8-9a4c-3b0823621d0e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:44.443348 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ce6f043-1872-49f8-9a4c-3b0823621d0e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:44.443814 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ce6f043-1872-49f8-9a4c-3b0823621d0e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:44.444241 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ce6f043-1872-49f8-9a4c-3b0823621d0e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:44.444927 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ce6f043-1872-49f8-9a4c-3b0823621d0e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:44.445389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ce6f043-1872-49f8-9a4c-3b0823621d0e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:44.445804 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4ce6f043-1872-49f8-9a4c-3b0823621d0e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:44.582064 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4ce6f043-1872-49f8-9a4c-3b0823621d0e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:44.598738 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4ce6f043-1872-49f8-9a4c-3b0823621d0e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:44.600631 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4ce6f043-1872-49f8-9a4c-3b0823621d0e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:44.601966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4ce6f043-1872-49f8-9a4c-3b0823621d0e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.171153 Aug 08 02:36:44.602855 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 500/985] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:44 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:45.629033 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ce028082-0ce9-472a-8757-887aee0fb32f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:45.629661 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ce028082-0ce9-472a-8757-887aee0fb32f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:45.636674 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce028082-0ce9-472a-8757-887aee0fb32f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:45.637359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce028082-0ce9-472a-8757-887aee0fb32f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:45.637909 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce028082-0ce9-472a-8757-887aee0fb32f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:45.638915 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce028082-0ce9-472a-8757-887aee0fb32f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:45.639875 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce028082-0ce9-472a-8757-887aee0fb32f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:45.640458 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce028082-0ce9-472a-8757-887aee0fb32f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:45.831661 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ce028082-0ce9-472a-8757-887aee0fb32f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:45.840346 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ce028082-0ce9-472a-8757-887aee0fb32f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:45.842340 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ce028082-0ce9-472a-8757-887aee0fb32f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:45.843569 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ce028082-0ce9-472a-8757-887aee0fb32f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.219588 Aug 08 02:36:45.844200 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 486/986] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:45 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:46.867501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8edd4df1-a3b0-4be5-8605-b41b000fcca6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:46.869032 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8edd4df1-a3b0-4be5-8605-b41b000fcca6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:46.876488 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8edd4df1-a3b0-4be5-8605-b41b000fcca6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:46.877020 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8edd4df1-a3b0-4be5-8605-b41b000fcca6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:46.877452 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8edd4df1-a3b0-4be5-8605-b41b000fcca6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:46.878207 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8edd4df1-a3b0-4be5-8605-b41b000fcca6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:46.879741 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8edd4df1-a3b0-4be5-8605-b41b000fcca6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:46.880217 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8edd4df1-a3b0-4be5-8605-b41b000fcca6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:47.081229 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8edd4df1-a3b0-4be5-8605-b41b000fcca6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:47.093383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8edd4df1-a3b0-4be5-8605-b41b000fcca6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:47.095456 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8edd4df1-a3b0-4be5-8605-b41b000fcca6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:47.096908 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8edd4df1-a3b0-4be5-8605-b41b000fcca6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.233830 Aug 08 02:36:47.098267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 501/987] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:46 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:48.124096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-32015642-0167-44e8-b028-b769e4b4ec31 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:48.125418 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-32015642-0167-44e8-b028-b769e4b4ec31 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:48.133276 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32015642-0167-44e8-b028-b769e4b4ec31 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:48.134018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32015642-0167-44e8-b028-b769e4b4ec31 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:48.135142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32015642-0167-44e8-b028-b769e4b4ec31 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:48.136906 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32015642-0167-44e8-b028-b769e4b4ec31 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:48.137796 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32015642-0167-44e8-b028-b769e4b4ec31 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:48.138637 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32015642-0167-44e8-b028-b769e4b4ec31 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:48.334663 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-32015642-0167-44e8-b028-b769e4b4ec31 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:48.343885 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-32015642-0167-44e8-b028-b769e4b4ec31 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:48.345686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-32015642-0167-44e8-b028-b769e4b4ec31 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:48.347160 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-32015642-0167-44e8-b028-b769e4b4ec31 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.227305 Aug 08 02:36:48.348331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 487/988] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:48 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:49.379192 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ad737991-69b8-4cf1-9f02-fcaf178f94b0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:49.379777 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ad737991-69b8-4cf1-9f02-fcaf178f94b0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:49.386162 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ad737991-69b8-4cf1-9f02-fcaf178f94b0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:49.386741 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ad737991-69b8-4cf1-9f02-fcaf178f94b0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:49.387242 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ad737991-69b8-4cf1-9f02-fcaf178f94b0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:49.387934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ad737991-69b8-4cf1-9f02-fcaf178f94b0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:49.388381 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ad737991-69b8-4cf1-9f02-fcaf178f94b0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:49.388800 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ad737991-69b8-4cf1-9f02-fcaf178f94b0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:49.552450 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ad737991-69b8-4cf1-9f02-fcaf178f94b0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:49.561539 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ad737991-69b8-4cf1-9f02-fcaf178f94b0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:49.563082 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ad737991-69b8-4cf1-9f02-fcaf178f94b0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:49.564249 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ad737991-69b8-4cf1-9f02-fcaf178f94b0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.189739 Aug 08 02:36:49.564825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 502/989] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:49 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:50.589124 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-84c9ed7f-f2ef-443a-a63a-4489a8ea2abc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:50.589678 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-84c9ed7f-f2ef-443a-a63a-4489a8ea2abc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:50.596392 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84c9ed7f-f2ef-443a-a63a-4489a8ea2abc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:50.596879 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84c9ed7f-f2ef-443a-a63a-4489a8ea2abc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:50.597874 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84c9ed7f-f2ef-443a-a63a-4489a8ea2abc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:50.598607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84c9ed7f-f2ef-443a-a63a-4489a8ea2abc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:50.599255 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84c9ed7f-f2ef-443a-a63a-4489a8ea2abc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:50.599683 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84c9ed7f-f2ef-443a-a63a-4489a8ea2abc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:50.743592 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-84c9ed7f-f2ef-443a-a63a-4489a8ea2abc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:50.752815 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-84c9ed7f-f2ef-443a-a63a-4489a8ea2abc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:50.754391 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-84c9ed7f-f2ef-443a-a63a-4489a8ea2abc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:50.755567 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-84c9ed7f-f2ef-443a-a63a-4489a8ea2abc tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.170585 Aug 08 02:36:50.756131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 488/990] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:50 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:51.779462 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-557d1fbf-fc8a-4446-85a0-be61a6ec4169 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:51.780835 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-557d1fbf-fc8a-4446-85a0-be61a6ec4169 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:51.790794 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-557d1fbf-fc8a-4446-85a0-be61a6ec4169 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:51.791616 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-557d1fbf-fc8a-4446-85a0-be61a6ec4169 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:51.792215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-557d1fbf-fc8a-4446-85a0-be61a6ec4169 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:51.793184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-557d1fbf-fc8a-4446-85a0-be61a6ec4169 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:51.793788 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-557d1fbf-fc8a-4446-85a0-be61a6ec4169 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:51.794543 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-557d1fbf-fc8a-4446-85a0-be61a6ec4169 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:51.932923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-557d1fbf-fc8a-4446-85a0-be61a6ec4169 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:51.942075 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-557d1fbf-fc8a-4446-85a0-be61a6ec4169 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:51.943920 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-557d1fbf-fc8a-4446-85a0-be61a6ec4169 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:51.945175 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-557d1fbf-fc8a-4446-85a0-be61a6ec4169 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.169714 Aug 08 02:36:51.945736 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 503/991] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:51 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:52.968370 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-953d4636-eb9d-4c69-82d6-232d4b8b276e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:52.968981 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-953d4636-eb9d-4c69-82d6-232d4b8b276e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:52.975394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-953d4636-eb9d-4c69-82d6-232d4b8b276e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:52.975872 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-953d4636-eb9d-4c69-82d6-232d4b8b276e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:52.976306 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-953d4636-eb9d-4c69-82d6-232d4b8b276e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:52.976988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-953d4636-eb9d-4c69-82d6-232d4b8b276e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:52.977464 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-953d4636-eb9d-4c69-82d6-232d4b8b276e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:52.977894 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-953d4636-eb9d-4c69-82d6-232d4b8b276e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:53.107413 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-953d4636-eb9d-4c69-82d6-232d4b8b276e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:53.116268 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-953d4636-eb9d-4c69-82d6-232d4b8b276e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:53.117770 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-953d4636-eb9d-4c69-82d6-232d4b8b276e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:53.118954 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-953d4636-eb9d-4c69-82d6-232d4b8b276e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.154516 Aug 08 02:36:53.119522 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 489/992] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:52 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:54.142547 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e549cf1f-17ea-469f-a92d-cad214fa5822 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:54.143232 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e549cf1f-17ea-469f-a92d-cad214fa5822 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:54.150721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e549cf1f-17ea-469f-a92d-cad214fa5822 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:54.151206 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e549cf1f-17ea-469f-a92d-cad214fa5822 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:54.151633 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e549cf1f-17ea-469f-a92d-cad214fa5822 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:54.152328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e549cf1f-17ea-469f-a92d-cad214fa5822 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:54.152773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e549cf1f-17ea-469f-a92d-cad214fa5822 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:54.153187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e549cf1f-17ea-469f-a92d-cad214fa5822 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:54.313302 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e549cf1f-17ea-469f-a92d-cad214fa5822 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:54.322475 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e549cf1f-17ea-469f-a92d-cad214fa5822 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:54.324000 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e549cf1f-17ea-469f-a92d-cad214fa5822 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:54.325142 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e549cf1f-17ea-469f-a92d-cad214fa5822 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.186665 Aug 08 02:36:54.325704 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 504/993] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:54 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:55.348737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eba5dd9e-a487-4c1c-b40a-7b9466ccf02c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:55.350118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eba5dd9e-a487-4c1c-b40a-7b9466ccf02c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:55.357235 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eba5dd9e-a487-4c1c-b40a-7b9466ccf02c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:55.357979 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eba5dd9e-a487-4c1c-b40a-7b9466ccf02c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:55.358697 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eba5dd9e-a487-4c1c-b40a-7b9466ccf02c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:55.359481 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eba5dd9e-a487-4c1c-b40a-7b9466ccf02c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:55.360008 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eba5dd9e-a487-4c1c-b40a-7b9466ccf02c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:55.360525 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eba5dd9e-a487-4c1c-b40a-7b9466ccf02c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:55.490328 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eba5dd9e-a487-4c1c-b40a-7b9466ccf02c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:55.498841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eba5dd9e-a487-4c1c-b40a-7b9466ccf02c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:55.500400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eba5dd9e-a487-4c1c-b40a-7b9466ccf02c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:55.501603 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eba5dd9e-a487-4c1c-b40a-7b9466ccf02c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.157448 Aug 08 02:36:55.502159 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 490/994] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:55 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:56.523055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-55db2d77-0590-4568-824c-c65590aa5343 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:56.523718 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-55db2d77-0590-4568-824c-c65590aa5343 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:56.530067 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55db2d77-0590-4568-824c-c65590aa5343 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:56.530720 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55db2d77-0590-4568-824c-c65590aa5343 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:56.531160 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55db2d77-0590-4568-824c-c65590aa5343 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:56.531842 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55db2d77-0590-4568-824c-c65590aa5343 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:56.532296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55db2d77-0590-4568-824c-c65590aa5343 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:56.532717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55db2d77-0590-4568-824c-c65590aa5343 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:56.658645 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-55db2d77-0590-4568-824c-c65590aa5343 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:56.667345 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-55db2d77-0590-4568-824c-c65590aa5343 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:56.668870 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-55db2d77-0590-4568-824c-c65590aa5343 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:56.669994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-55db2d77-0590-4568-824c-c65590aa5343 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.150818 Aug 08 02:36:56.670653 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 505/995] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:56 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:57.697447 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8de9f474-c678-4153-a191-881fd58bdb73 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:57.698052 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8de9f474-c678-4153-a191-881fd58bdb73 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:57.704492 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8de9f474-c678-4153-a191-881fd58bdb73 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:57.704965 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8de9f474-c678-4153-a191-881fd58bdb73 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:57.705392 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8de9f474-c678-4153-a191-881fd58bdb73 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:57.706068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8de9f474-c678-4153-a191-881fd58bdb73 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:57.706539 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8de9f474-c678-4153-a191-881fd58bdb73 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:57.706956 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8de9f474-c678-4153-a191-881fd58bdb73 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:57.839620 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8de9f474-c678-4153-a191-881fd58bdb73 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:57.848472 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8de9f474-c678-4153-a191-881fd58bdb73 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:57.849944 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8de9f474-c678-4153-a191-881fd58bdb73 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:57.851142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8de9f474-c678-4153-a191-881fd58bdb73 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.158166 Aug 08 02:36:57.851703 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 491/996] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:57 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:36:58.874831 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-de723269-607e-4d84-adf7-dbe7eb65b203 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:36:58.875431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-de723269-607e-4d84-adf7-dbe7eb65b203 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:36:58.882453 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de723269-607e-4d84-adf7-dbe7eb65b203 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:58.882939 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de723269-607e-4d84-adf7-dbe7eb65b203 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:58.883372 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de723269-607e-4d84-adf7-dbe7eb65b203 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:58.884060 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de723269-607e-4d84-adf7-dbe7eb65b203 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:36:58.884511 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de723269-607e-4d84-adf7-dbe7eb65b203 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:36:58.884936 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de723269-607e-4d84-adf7-dbe7eb65b203 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:36:59.014581 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-de723269-607e-4d84-adf7-dbe7eb65b203 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:59.023677 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-de723269-607e-4d84-adf7-dbe7eb65b203 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:59.025176 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-de723269-607e-4d84-adf7-dbe7eb65b203 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:36:59.026366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-de723269-607e-4d84-adf7-dbe7eb65b203 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.155483 Aug 08 02:36:59.026931 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 506/997] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:36:58 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:00.049069 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c50e2f13-ad57-4f77-b03c-1793b493a709 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:00.049677 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c50e2f13-ad57-4f77-b03c-1793b493a709 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:00.056153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c50e2f13-ad57-4f77-b03c-1793b493a709 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:00.056624 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c50e2f13-ad57-4f77-b03c-1793b493a709 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:00.057053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c50e2f13-ad57-4f77-b03c-1793b493a709 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:00.057731 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c50e2f13-ad57-4f77-b03c-1793b493a709 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:00.058183 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c50e2f13-ad57-4f77-b03c-1793b493a709 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:00.058628 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c50e2f13-ad57-4f77-b03c-1793b493a709 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:00.186150 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c50e2f13-ad57-4f77-b03c-1793b493a709 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:00.188339 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:00.196812 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c50e2f13-ad57-4f77-b03c-1793b493a709 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:00.198328 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c50e2f13-ad57-4f77-b03c-1793b493a709 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:00.199482 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c50e2f13-ad57-4f77-b03c-1793b493a709 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.154314 Aug 08 02:37:00.200059 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 492/998] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:00 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:01.223044 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-882c0525-1cbc-4d3f-a7b7-e21b326eb729 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:01.223646 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-882c0525-1cbc-4d3f-a7b7-e21b326eb729 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:01.230545 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-882c0525-1cbc-4d3f-a7b7-e21b326eb729 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:01.231018 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-882c0525-1cbc-4d3f-a7b7-e21b326eb729 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:01.231444 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-882c0525-1cbc-4d3f-a7b7-e21b326eb729 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:01.232116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-882c0525-1cbc-4d3f-a7b7-e21b326eb729 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:01.232563 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-882c0525-1cbc-4d3f-a7b7-e21b326eb729 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:01.232986 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-882c0525-1cbc-4d3f-a7b7-e21b326eb729 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:01.359200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-882c0525-1cbc-4d3f-a7b7-e21b326eb729 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:01.367470 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-882c0525-1cbc-4d3f-a7b7-e21b326eb729 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:01.368963 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-882c0525-1cbc-4d3f-a7b7-e21b326eb729 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:01.370098 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-882c0525-1cbc-4d3f-a7b7-e21b326eb729 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.150975 Aug 08 02:37:01.370686 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 507/999] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:01 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:02.392937 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fd75538b-9db2-4729-a02c-6b8fb9130b06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:02.393553 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fd75538b-9db2-4729-a02c-6b8fb9130b06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:02.401092 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fd75538b-9db2-4729-a02c-6b8fb9130b06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:02.401572 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fd75538b-9db2-4729-a02c-6b8fb9130b06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:02.402014 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fd75538b-9db2-4729-a02c-6b8fb9130b06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:02.402742 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fd75538b-9db2-4729-a02c-6b8fb9130b06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:02.403198 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fd75538b-9db2-4729-a02c-6b8fb9130b06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:02.403623 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fd75538b-9db2-4729-a02c-6b8fb9130b06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:02.542241 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fd75538b-9db2-4729-a02c-6b8fb9130b06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:02.550696 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fd75538b-9db2-4729-a02c-6b8fb9130b06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:02.552905 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fd75538b-9db2-4729-a02c-6b8fb9130b06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:02.554058 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fd75538b-9db2-4729-a02c-6b8fb9130b06 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.164969 Aug 08 02:37:02.554656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 493/1000] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:02 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:03.576863 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1c96272b-f7ed-4e34-be9d-30d59542f739 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:03.577478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1c96272b-f7ed-4e34-be9d-30d59542f739 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:03.584596 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c96272b-f7ed-4e34-be9d-30d59542f739 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:03.585068 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c96272b-f7ed-4e34-be9d-30d59542f739 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:03.585497 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c96272b-f7ed-4e34-be9d-30d59542f739 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:03.586177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c96272b-f7ed-4e34-be9d-30d59542f739 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:03.586653 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c96272b-f7ed-4e34-be9d-30d59542f739 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:03.587075 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1c96272b-f7ed-4e34-be9d-30d59542f739 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:03.718367 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1c96272b-f7ed-4e34-be9d-30d59542f739 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:03.727033 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1c96272b-f7ed-4e34-be9d-30d59542f739 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:03.728543 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1c96272b-f7ed-4e34-be9d-30d59542f739 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:03.729695 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1c96272b-f7ed-4e34-be9d-30d59542f739 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.156725 Aug 08 02:37:03.730270 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 508/1001] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:03 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:04.752623 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1868899c-bff1-4d0a-82de-8b96596affd5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:04.753232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1868899c-bff1-4d0a-82de-8b96596affd5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:04.755702 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=32 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:04.760790 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1868899c-bff1-4d0a-82de-8b96596affd5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:04.761267 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1868899c-bff1-4d0a-82de-8b96596affd5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:04.761693 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1868899c-bff1-4d0a-82de-8b96596affd5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:04.762406 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1868899c-bff1-4d0a-82de-8b96596affd5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:04.762937 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1868899c-bff1-4d0a-82de-8b96596affd5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:04.763264 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1868899c-bff1-4d0a-82de-8b96596affd5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:04.893530 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1868899c-bff1-4d0a-82de-8b96596affd5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:04.902432 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1868899c-bff1-4d0a-82de-8b96596affd5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:04.903960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1868899c-bff1-4d0a-82de-8b96596affd5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:04.905121 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1868899c-bff1-4d0a-82de-8b96596affd5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.156450 Aug 08 02:37:04.905673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 494/1002] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:04 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:05.929599 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-10e46c2d-593d-4efe-ad79-243ec489e2bd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:05.930445 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-10e46c2d-593d-4efe-ad79-243ec489e2bd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:05.938153 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10e46c2d-593d-4efe-ad79-243ec489e2bd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:05.938869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10e46c2d-593d-4efe-ad79-243ec489e2bd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:05.939617 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10e46c2d-593d-4efe-ad79-243ec489e2bd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:05.940755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10e46c2d-593d-4efe-ad79-243ec489e2bd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:05.941314 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10e46c2d-593d-4efe-ad79-243ec489e2bd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:05.941889 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-10e46c2d-593d-4efe-ad79-243ec489e2bd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:06.082110 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-10e46c2d-593d-4efe-ad79-243ec489e2bd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:06.090019 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-10e46c2d-593d-4efe-ad79-243ec489e2bd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:06.091644 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-10e46c2d-593d-4efe-ad79-243ec489e2bd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:06.092913 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-10e46c2d-593d-4efe-ad79-243ec489e2bd tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.168044 Aug 08 02:37:06.094062 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 509/1003] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:05 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:06.131970 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4fb4194b-7a5c-44cb-9f1c-74b1a216d29b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:06.132452 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4fb4194b-7a5c-44cb-9f1c-74b1a216d29b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:06.138754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fb4194b-7a5c-44cb-9f1c-74b1a216d29b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:06.139238 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fb4194b-7a5c-44cb-9f1c-74b1a216d29b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:06.139664 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fb4194b-7a5c-44cb-9f1c-74b1a216d29b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:06.140352 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fb4194b-7a5c-44cb-9f1c-74b1a216d29b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:06.141040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fb4194b-7a5c-44cb-9f1c-74b1a216d29b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:06.141526 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fb4194b-7a5c-44cb-9f1c-74b1a216d29b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:06.230118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-4fb4194b-7a5c-44cb-9f1c-74b1a216d29b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lazy-loading 'services' on Instance uuid 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:37:06.301146 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4fb4194b-7a5c-44cb-9f1c-74b1a216d29b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8/os-volume_attachments/7f822fb4-ff96-42a1-a96f-5dd79c2a4b0b" status: 202 len: 0 microversion: 2.1 time: 0.172891 Aug 08 02:37:06.301746 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 495/1004] 10.222.0.39 () {58 vars in 1416 bytes} [Mon Aug 8 02:37:06 2022] DELETE /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8/os-volume_attachments/7f822fb4-ff96-42a1-a96f-5dd79c2a4b0b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:37:06.310212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ac41ee0f-68b4-4921-9f67-4ceda9df08d8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:06.312504 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ac41ee0f-68b4-4921-9f67-4ceda9df08d8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:06.319302 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ac41ee0f-68b4-4921-9f67-4ceda9df08d8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:06.320218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ac41ee0f-68b4-4921-9f67-4ceda9df08d8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:06.320671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ac41ee0f-68b4-4921-9f67-4ceda9df08d8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:06.321373 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ac41ee0f-68b4-4921-9f67-4ceda9df08d8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:06.321832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ac41ee0f-68b4-4921-9f67-4ceda9df08d8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:06.322267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ac41ee0f-68b4-4921-9f67-4ceda9df08d8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:06.354426 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ac41ee0f-68b4-4921-9f67-4ceda9df08d8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047997 Aug 08 02:37:06.354985 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 510/1005] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:37:06 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:37:07.117447 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-492d104f-1e33-4e96-b80d-379243f8858b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:07.118148 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-492d104f-1e33-4e96-b80d-379243f8858b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:07.124381 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-492d104f-1e33-4e96-b80d-379243f8858b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:07.124840 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-492d104f-1e33-4e96-b80d-379243f8858b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:07.125271 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-492d104f-1e33-4e96-b80d-379243f8858b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:07.125956 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-492d104f-1e33-4e96-b80d-379243f8858b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:07.126441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-492d104f-1e33-4e96-b80d-379243f8858b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:07.126864 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-492d104f-1e33-4e96-b80d-379243f8858b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:07.260684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-492d104f-1e33-4e96-b80d-379243f8858b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:07.269374 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-492d104f-1e33-4e96-b80d-379243f8858b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:07.271040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-492d104f-1e33-4e96-b80d-379243f8858b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:07.272230 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-492d104f-1e33-4e96-b80d-379243f8858b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.159655 Aug 08 02:37:07.272786 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 496/1006] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:07 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:07.367288 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8a77159b-6b80-425c-8a7f-67a0f85a99dd tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:07.369484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8a77159b-6b80-425c-8a7f-67a0f85a99dd tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:07.376090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8a77159b-6b80-425c-8a7f-67a0f85a99dd tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:07.376563 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8a77159b-6b80-425c-8a7f-67a0f85a99dd tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:07.377174 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8a77159b-6b80-425c-8a7f-67a0f85a99dd tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:07.377864 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8a77159b-6b80-425c-8a7f-67a0f85a99dd tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:07.378340 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8a77159b-6b80-425c-8a7f-67a0f85a99dd tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:07.378760 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8a77159b-6b80-425c-8a7f-67a0f85a99dd tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:07.557944 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8a77159b-6b80-425c-8a7f-67a0f85a99dd tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.195282 Aug 08 02:37:07.558529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 511/1007] 10.222.0.39 () {58 vars in 1302 bytes} [Mon Aug 8 02:37:07 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8/os-volume_attachments => generated 25 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 02:37:07.619142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-738cff94-86f4-41da-b6ce-546b0c8d9dd8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:07.619646 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-738cff94-86f4-41da-b6ce-546b0c8d9dd8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:07.625502 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-738cff94-86f4-41da-b6ce-546b0c8d9dd8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:07.626015 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-738cff94-86f4-41da-b6ce-546b0c8d9dd8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:07.626485 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-738cff94-86f4-41da-b6ce-546b0c8d9dd8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:07.627199 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-738cff94-86f4-41da-b6ce-546b0c8d9dd8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:07.627652 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-738cff94-86f4-41da-b6ce-546b0c8d9dd8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:07.628077 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-738cff94-86f4-41da-b6ce-546b0c8d9dd8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:07.652288 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-738cff94-86f4-41da-b6ce-546b0c8d9dd8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:37:07.727750 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-738cff94-86f4-41da-b6ce-546b0c8d9dd8 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 204 len: 0 microversion: 2.1 time: 0.112817 Aug 08 02:37:07.728444 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 497/1008] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:37:07 2022] DELETE /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:37:07.736736 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-54ae3e32-2597-4a72-99f8-3c5060806ac4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:07.737339 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-54ae3e32-2597-4a72-99f8-3c5060806ac4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:07.743298 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54ae3e32-2597-4a72-99f8-3c5060806ac4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:07.743771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54ae3e32-2597-4a72-99f8-3c5060806ac4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:07.744197 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54ae3e32-2597-4a72-99f8-3c5060806ac4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:07.744868 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54ae3e32-2597-4a72-99f8-3c5060806ac4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:07.745311 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54ae3e32-2597-4a72-99f8-3c5060806ac4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:07.745725 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-54ae3e32-2597-4a72-99f8-3c5060806ac4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:07.872126 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-54ae3e32-2597-4a72-99f8-3c5060806ac4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:07.879705 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-54ae3e32-2597-4a72-99f8-3c5060806ac4 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1683 microversion: 2.1 time: 0.146736 Aug 08 02:37:07.880267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 512/1009] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:07 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:08.296621 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fcf856ed-f23e-4933-bddf-3a489749109c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:08.297323 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fcf856ed-f23e-4933-bddf-3a489749109c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:08.303662 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcf856ed-f23e-4933-bddf-3a489749109c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:08.304139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcf856ed-f23e-4933-bddf-3a489749109c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:08.304571 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcf856ed-f23e-4933-bddf-3a489749109c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:08.305254 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcf856ed-f23e-4933-bddf-3a489749109c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:08.305704 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcf856ed-f23e-4933-bddf-3a489749109c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:08.306133 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fcf856ed-f23e-4933-bddf-3a489749109c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:08.438474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fcf856ed-f23e-4933-bddf-3a489749109c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:08.448318 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fcf856ed-f23e-4933-bddf-3a489749109c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:08.454152 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fcf856ed-f23e-4933-bddf-3a489749109c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:08.454152 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fcf856ed-f23e-4933-bddf-3a489749109c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.158797 Aug 08 02:37:08.454152 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 498/1010] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:08 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:08.899801 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8507607e-8ec6-4a62-8d7e-a10ab2239f74 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:08.900411 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8507607e-8ec6-4a62-8d7e-a10ab2239f74 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:08.906893 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8507607e-8ec6-4a62-8d7e-a10ab2239f74 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:08.907371 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8507607e-8ec6-4a62-8d7e-a10ab2239f74 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:08.907802 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8507607e-8ec6-4a62-8d7e-a10ab2239f74 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:08.908483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8507607e-8ec6-4a62-8d7e-a10ab2239f74 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:08.908934 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8507607e-8ec6-4a62-8d7e-a10ab2239f74 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:08.909356 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8507607e-8ec6-4a62-8d7e-a10ab2239f74 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:09.039464 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8507607e-8ec6-4a62-8d7e-a10ab2239f74 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:09.041747 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:09.048444 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8507607e-8ec6-4a62-8d7e-a10ab2239f74 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1683 microversion: 2.1 time: 0.152483 Aug 08 02:37:09.049005 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 513/1011] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:08 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:09.472867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-78fda61f-951e-4767-ab3f-4f1616585201 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:09.473478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-78fda61f-951e-4767-ab3f-4f1616585201 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:09.480571 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78fda61f-951e-4767-ab3f-4f1616585201 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:09.481051 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78fda61f-951e-4767-ab3f-4f1616585201 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:09.481484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78fda61f-951e-4767-ab3f-4f1616585201 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:09.482169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78fda61f-951e-4767-ab3f-4f1616585201 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:09.482645 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78fda61f-951e-4767-ab3f-4f1616585201 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:09.483064 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78fda61f-951e-4767-ab3f-4f1616585201 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:09.609146 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-78fda61f-951e-4767-ab3f-4f1616585201 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:09.617543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-78fda61f-951e-4767-ab3f-4f1616585201 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:09.619094 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-78fda61f-951e-4767-ab3f-4f1616585201 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:09.620246 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-78fda61f-951e-4767-ab3f-4f1616585201 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.151241 Aug 08 02:37:09.620801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 499/1012] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:09 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:10.070714 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-44211721-26c0-4ab1-8337-9138838c62e0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:10.071320 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-44211721-26c0-4ab1-8337-9138838c62e0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:10.078964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-44211721-26c0-4ab1-8337-9138838c62e0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:10.079441 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-44211721-26c0-4ab1-8337-9138838c62e0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:10.079870 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-44211721-26c0-4ab1-8337-9138838c62e0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:10.080550 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-44211721-26c0-4ab1-8337-9138838c62e0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:10.080995 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-44211721-26c0-4ab1-8337-9138838c62e0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:10.081413 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-44211721-26c0-4ab1-8337-9138838c62e0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:10.211804 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-44211721-26c0-4ab1-8337-9138838c62e0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:10.220501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-44211721-26c0-4ab1-8337-9138838c62e0 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1683 microversion: 2.1 time: 0.154255 Aug 08 02:37:10.221057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 514/1013] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:10 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:10.643026 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-073fbad5-9a3c-4522-9e40-ad8596ebb69a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:10.643638 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-073fbad5-9a3c-4522-9e40-ad8596ebb69a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:10.650609 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-073fbad5-9a3c-4522-9e40-ad8596ebb69a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:10.651089 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-073fbad5-9a3c-4522-9e40-ad8596ebb69a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:10.651522 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-073fbad5-9a3c-4522-9e40-ad8596ebb69a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:10.652202 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-073fbad5-9a3c-4522-9e40-ad8596ebb69a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:10.652652 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-073fbad5-9a3c-4522-9e40-ad8596ebb69a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:10.653074 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-073fbad5-9a3c-4522-9e40-ad8596ebb69a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:10.781429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-073fbad5-9a3c-4522-9e40-ad8596ebb69a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:10.790505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-073fbad5-9a3c-4522-9e40-ad8596ebb69a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:10.792024 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-073fbad5-9a3c-4522-9e40-ad8596ebb69a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:10.793174 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-073fbad5-9a3c-4522-9e40-ad8596ebb69a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.154063 Aug 08 02:37:10.793730 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 500/1014] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:10 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:11.240519 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4f40f578-36ef-4483-b48b-9f496c0a1d28 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:11.241132 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4f40f578-36ef-4483-b48b-9f496c0a1d28 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:11.243433 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=34 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:11.248844 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4f40f578-36ef-4483-b48b-9f496c0a1d28 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:11.249323 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4f40f578-36ef-4483-b48b-9f496c0a1d28 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:11.249755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4f40f578-36ef-4483-b48b-9f496c0a1d28 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:11.250467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4f40f578-36ef-4483-b48b-9f496c0a1d28 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:11.250919 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4f40f578-36ef-4483-b48b-9f496c0a1d28 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:11.251338 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4f40f578-36ef-4483-b48b-9f496c0a1d28 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:11.379787 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4f40f578-36ef-4483-b48b-9f496c0a1d28 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:11.387832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4f40f578-36ef-4483-b48b-9f496c0a1d28 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1683 microversion: 2.1 time: 0.151314 Aug 08 02:37:11.388387 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 515/1015] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:11 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:11.816429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4552c007-b2d6-46ca-9b6d-d89870242255 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:11.816968 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4552c007-b2d6-46ca-9b6d-d89870242255 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:11.823395 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4552c007-b2d6-46ca-9b6d-d89870242255 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:11.823875 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4552c007-b2d6-46ca-9b6d-d89870242255 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:11.824309 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4552c007-b2d6-46ca-9b6d-d89870242255 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:11.824992 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4552c007-b2d6-46ca-9b6d-d89870242255 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:11.825441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4552c007-b2d6-46ca-9b6d-d89870242255 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:11.825865 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4552c007-b2d6-46ca-9b6d-d89870242255 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:11.959839 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4552c007-b2d6-46ca-9b6d-d89870242255 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:11.968206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4552c007-b2d6-46ca-9b6d-d89870242255 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:11.969705 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4552c007-b2d6-46ca-9b6d-d89870242255 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:11.970886 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4552c007-b2d6-46ca-9b6d-d89870242255 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.158733 Aug 08 02:37:11.971444 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 501/1016] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:11 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:12.408551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0b34a708-7522-4c10-a1d9-513b798cbcc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:12.409155 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0b34a708-7522-4c10-a1d9-513b798cbcc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:12.417205 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b34a708-7522-4c10-a1d9-513b798cbcc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:12.417801 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b34a708-7522-4c10-a1d9-513b798cbcc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:12.418354 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b34a708-7522-4c10-a1d9-513b798cbcc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:12.419082 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b34a708-7522-4c10-a1d9-513b798cbcc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:12.419545 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b34a708-7522-4c10-a1d9-513b798cbcc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:12.419974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b34a708-7522-4c10-a1d9-513b798cbcc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:12.546225 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0b34a708-7522-4c10-a1d9-513b798cbcc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:12.553772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0b34a708-7522-4c10-a1d9-513b798cbcc7 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1683 microversion: 2.1 time: 0.149015 Aug 08 02:37:12.558286 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 516/1017] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:12 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:12.994903 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4060b7ad-7224-450c-a1b5-c3cfe28aac30 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:12.995515 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4060b7ad-7224-450c-a1b5-c3cfe28aac30 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:13.001429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4060b7ad-7224-450c-a1b5-c3cfe28aac30 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:13.001838 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4060b7ad-7224-450c-a1b5-c3cfe28aac30 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:13.002279 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4060b7ad-7224-450c-a1b5-c3cfe28aac30 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:13.002956 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4060b7ad-7224-450c-a1b5-c3cfe28aac30 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:13.003403 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4060b7ad-7224-450c-a1b5-c3cfe28aac30 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:13.003816 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4060b7ad-7224-450c-a1b5-c3cfe28aac30 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:13.133157 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4060b7ad-7224-450c-a1b5-c3cfe28aac30 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:13.141542 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4060b7ad-7224-450c-a1b5-c3cfe28aac30 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:13.143075 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4060b7ad-7224-450c-a1b5-c3cfe28aac30 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:13.144218 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4060b7ad-7224-450c-a1b5-c3cfe28aac30 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.154036 Aug 08 02:37:13.144776 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 502/1018] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:12 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:13.574814 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4fc585c2-5a1c-4af5-b39a-d12ebdf5f545 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:13.575418 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4fc585c2-5a1c-4af5-b39a-d12ebdf5f545 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:13.582187 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4fc585c2-5a1c-4af5-b39a-d12ebdf5f545 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:13.582688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4fc585c2-5a1c-4af5-b39a-d12ebdf5f545 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:13.583112 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4fc585c2-5a1c-4af5-b39a-d12ebdf5f545 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:13.583813 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4fc585c2-5a1c-4af5-b39a-d12ebdf5f545 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:13.584255 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4fc585c2-5a1c-4af5-b39a-d12ebdf5f545 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:13.584668 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4fc585c2-5a1c-4af5-b39a-d12ebdf5f545 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:13.714721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4fc585c2-5a1c-4af5-b39a-d12ebdf5f545 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:13.722110 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4fc585c2-5a1c-4af5-b39a-d12ebdf5f545 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1683 microversion: 2.1 time: 0.151205 Aug 08 02:37:13.722690 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 517/1019] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:13 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:14.168066 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e8de5667-bd9d-4975-a901-7cd004a5be50 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:14.168680 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e8de5667-bd9d-4975-a901-7cd004a5be50 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:14.175268 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8de5667-bd9d-4975-a901-7cd004a5be50 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:14.175751 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8de5667-bd9d-4975-a901-7cd004a5be50 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:14.176181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8de5667-bd9d-4975-a901-7cd004a5be50 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:14.176873 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8de5667-bd9d-4975-a901-7cd004a5be50 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:14.177486 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8de5667-bd9d-4975-a901-7cd004a5be50 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:14.177968 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e8de5667-bd9d-4975-a901-7cd004a5be50 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:14.319843 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e8de5667-bd9d-4975-a901-7cd004a5be50 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:14.328737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e8de5667-bd9d-4975-a901-7cd004a5be50 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:14.330974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e8de5667-bd9d-4975-a901-7cd004a5be50 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:14.332305 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e8de5667-bd9d-4975-a901-7cd004a5be50 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.168925 Aug 08 02:37:14.346568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 503/1020] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:14 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:14.743565 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f542d3aa-d67b-493a-9674-78c34ecc5a36 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:14.744172 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f542d3aa-d67b-493a-9674-78c34ecc5a36 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:14.750947 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f542d3aa-d67b-493a-9674-78c34ecc5a36 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:14.751422 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f542d3aa-d67b-493a-9674-78c34ecc5a36 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:14.751843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f542d3aa-d67b-493a-9674-78c34ecc5a36 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:14.752522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f542d3aa-d67b-493a-9674-78c34ecc5a36 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:14.752982 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f542d3aa-d67b-493a-9674-78c34ecc5a36 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:14.753397 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f542d3aa-d67b-493a-9674-78c34ecc5a36 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:14.833504 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f542d3aa-d67b-493a-9674-78c34ecc5a36 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd72b161f8442285dea411741d66b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c533d28fa3f4d11b88b630a7c7bd1b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:14.841835 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f542d3aa-d67b-493a-9674-78c34ecc5a36 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 200 len: 1615 microversion: 2.1 time: 0.102096 Aug 08 02:37:14.843046 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 518/1021] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:14 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 1615 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:37:15.164111 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-7037895b-f4d7-4b90-9e37-b3f618d64c69 req-dba42277-efd3-49e2-8b61-f359a635504f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f771edb-4a7d-4509-b58f-af57c6e1d6d8", "name": "network-vif-deleted", "tag": "3759ebe1-94c7-4ce7-a37e-9dd069547565"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:37:15.181315 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-7037895b-f4d7-4b90-9e37-b3f618d64c69 req-dba42277-efd3-49e2-8b61-f359a635504f service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:15.182534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-7037895b-f4d7-4b90-9e37-b3f618d64c69 req-dba42277-efd3-49e2-8b61-f359a635504f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:15.183118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-7037895b-f4d7-4b90-9e37-b3f618d64c69 req-dba42277-efd3-49e2-8b61-f359a635504f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:15.201917 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-7037895b-f4d7-4b90-9e37-b3f618d64c69 req-dba42277-efd3-49e2-8b61-f359a635504f service nova] Creating event network-vif-deleted:3759ebe1-94c7-4ce7-a37e-9dd069547565 for instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 on hv-cinder-73306 Aug 08 02:37:15.216260 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-7037895b-f4d7-4b90-9e37-b3f618d64c69 req-dba42277-efd3-49e2-8b61-f359a635504f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203163 Aug 08 02:37:15.221308 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 504/1022] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:37:15.357003 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-978fbde8-1f6a-4121-9082-50dc5b662ccf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:15.357535 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-978fbde8-1f6a-4121-9082-50dc5b662ccf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:15.364279 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-978fbde8-1f6a-4121-9082-50dc5b662ccf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:15.364770 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-978fbde8-1f6a-4121-9082-50dc5b662ccf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:15.365735 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-978fbde8-1f6a-4121-9082-50dc5b662ccf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:15.366528 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-978fbde8-1f6a-4121-9082-50dc5b662ccf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:15.367244 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-978fbde8-1f6a-4121-9082-50dc5b662ccf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:15.367838 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-978fbde8-1f6a-4121-9082-50dc5b662ccf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:15.516006 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-978fbde8-1f6a-4121-9082-50dc5b662ccf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:15.525848 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-978fbde8-1f6a-4121-9082-50dc5b662ccf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:15.527470 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-978fbde8-1f6a-4121-9082-50dc5b662ccf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:15.528820 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-978fbde8-1f6a-4121-9082-50dc5b662ccf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.175914 Aug 08 02:37:15.529402 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 519/1023] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:15 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:15.863242 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1181299a-d6db-4a4f-afcd-29c4014f889b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:15.863869 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1181299a-d6db-4a4f-afcd-29c4014f889b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:15.870640 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1181299a-d6db-4a4f-afcd-29c4014f889b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:15.871121 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1181299a-d6db-4a4f-afcd-29c4014f889b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:15.871551 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1181299a-d6db-4a4f-afcd-29c4014f889b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:15.872232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1181299a-d6db-4a4f-afcd-29c4014f889b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:15.872685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1181299a-d6db-4a4f-afcd-29c4014f889b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:15.873103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1181299a-d6db-4a4f-afcd-29c4014f889b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:15.886215 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-1181299a-d6db-4a4f-afcd-29c4014f889b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1181299a-d6db-4a4f-afcd-29c4014f889b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 HTTP/1.1 Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:37:15.887868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:37:15.889474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:37:15.889474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:15.889474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:15.889474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:15.889474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:15.889474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:37:15.889474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:37:15.889474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:37:15.889474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:15.889474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:37:15.889474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:15.889474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '0f771edb-4a7d-4509-b58f-af57c6e1d6d8'} Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:37:15.893568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:15.895196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:15.897067 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1181299a-d6db-4a4f-afcd-29c4014f889b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 404 to user: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:37:15.897067 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1181299a-d6db-4a4f-afcd-29c4014f889b tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 404 len: 111 microversion: 2.1 time: 0.030369 Aug 08 02:37:15.897067 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 505/1024] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:15 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:37:15.898524 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4d4df95d-5053-4cc8-878a-e1a868aab775 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '.version_select at 0x7f3295101700>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:15.903072 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d4df95d-5053-4cc8-878a-e1a868aab775 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [987b6325-37ec-45aa-8e71-f175a68a7622] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 02:37:16.277741 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-6101225a-399f-4f96-b4c5-79f1ff8faad3 req-873a69d6-fb50-4a50-97bb-46d9baca26b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614b1928-9870-453b-8bf7-7b21f36ed2be", "name": "network-vif-plugged", "status": "completed", "tag": "2d321e72-03cd-4396-9683-df053c6107d1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:37:16.288342 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6101225a-399f-4f96-b4c5-79f1ff8faad3 req-873a69d6-fb50-4a50-97bb-46d9baca26b4 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:16.288821 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6101225a-399f-4f96-b4c5-79f1ff8faad3 req-873a69d6-fb50-4a50-97bb-46d9baca26b4 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:16.289244 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6101225a-399f-4f96-b4c5-79f1ff8faad3 req-873a69d6-fb50-4a50-97bb-46d9baca26b4 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:16.300429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-6101225a-399f-4f96-b4c5-79f1ff8faad3 req-873a69d6-fb50-4a50-97bb-46d9baca26b4 service nova] Creating event network-vif-plugged:2d321e72-03cd-4396-9683-df053c6107d1 for instance 614b1928-9870-453b-8bf7-7b21f36ed2be on hv-cinder-73306 Aug 08 02:37:16.305524 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-6101225a-399f-4f96-b4c5-79f1ff8faad3 req-873a69d6-fb50-4a50-97bb-46d9baca26b4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031533 Aug 08 02:37:16.306118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 506/1025] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:37:16.553381 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bb6afe57-7a22-4cb0-92d1-fc2769020e9b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:16.554082 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bb6afe57-7a22-4cb0-92d1-fc2769020e9b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:16.560131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb6afe57-7a22-4cb0-92d1-fc2769020e9b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:16.560607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb6afe57-7a22-4cb0-92d1-fc2769020e9b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:16.561032 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb6afe57-7a22-4cb0-92d1-fc2769020e9b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:16.561714 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb6afe57-7a22-4cb0-92d1-fc2769020e9b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:16.562156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb6afe57-7a22-4cb0-92d1-fc2769020e9b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:16.562597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb6afe57-7a22-4cb0-92d1-fc2769020e9b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:16.706212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bb6afe57-7a22-4cb0-92d1-fc2769020e9b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:16.716503 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bb6afe57-7a22-4cb0-92d1-fc2769020e9b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:16.718286 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bb6afe57-7a22-4cb0-92d1-fc2769020e9b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:16.719551 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bb6afe57-7a22-4cb0-92d1-fc2769020e9b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.170473 Aug 08 02:37:16.734653 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 507/1026] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:16 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:37:16.913121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d4df95d-5053-4cc8-878a-e1a868aab775 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [987b6325-37ec-45aa-8e71-f175a68a7622] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 50536. Aug 08 02:37:16.932213 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4d4df95d-5053-4cc8-878a-e1a868aab775 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922015860" status: 202 len: 0 microversion: 2.1 time: 1.037916 Aug 08 02:37:16.932814 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 520/1027] 10.222.0.39 () {58 vars in 1221 bytes} [Mon Aug 8 02:37:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922015860 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 02:37:17.745080 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9bc4bba9-e54e-46a0-a9c4-ce97dba684f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:17.745708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9bc4bba9-e54e-46a0-a9c4-ce97dba684f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:17.752173 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9bc4bba9-e54e-46a0-a9c4-ce97dba684f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:17.752873 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9bc4bba9-e54e-46a0-a9c4-ce97dba684f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:17.753529 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9bc4bba9-e54e-46a0-a9c4-ce97dba684f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:17.754345 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9bc4bba9-e54e-46a0-a9c4-ce97dba684f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:17.754734 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9bc4bba9-e54e-46a0-a9c4-ce97dba684f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:17.755353 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9bc4bba9-e54e-46a0-a9c4-ce97dba684f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:17.894679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9bc4bba9-e54e-46a0-a9c4-ce97dba684f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:17.904342 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9bc4bba9-e54e-46a0-a9c4-ce97dba684f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:17.906009 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9bc4bba9-e54e-46a0-a9c4-ce97dba684f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:17.907300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9bc4bba9-e54e-46a0-a9c4-ce97dba684f9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.166672 Aug 08 02:37:17.907933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 508/1028] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:17 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:18.825119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fa07da50-cf56-4880-acb9-5c8a474e3eaa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:18.825688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-fa07da50-cf56-4880-acb9-5c8a474e3eaa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:18.831744 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fa07da50-cf56-4880-acb9-5c8a474e3eaa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:18.832299 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fa07da50-cf56-4880-acb9-5c8a474e3eaa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:18.832804 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fa07da50-cf56-4880-acb9-5c8a474e3eaa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:18.833560 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fa07da50-cf56-4880-acb9-5c8a474e3eaa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:18.834655 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fa07da50-cf56-4880-acb9-5c8a474e3eaa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:18.835080 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fa07da50-cf56-4880-acb9-5c8a474e3eaa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:18.848386 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-fa07da50-cf56-4880-acb9-5c8a474e3eaa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fa07da50-cf56-4880-acb9-5c8a474e3eaa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: DELETE /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 HTTP/1.1 Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:37:18.850111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:37:18.851754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:37:18.851754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:18.851754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:18.851754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:18.851754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:18.851754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:37:18.851754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:37:18.851754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:37:18.851754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:18.851754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:37:18.851754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:18.851754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '0f771edb-4a7d-4509-b58f-af57c6e1d6d8'} Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:37:18.855825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:18.857303 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:18.858819 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fa07da50-cf56-4880-acb9-5c8a474e3eaa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 404 to user: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:37:18.858819 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fa07da50-cf56-4880-acb9-5c8a474e3eaa tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 404 len: 111 microversion: 2.1 time: 0.030884 Aug 08 02:37:18.858819 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 521/1029] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:37:18 2022] DELETE /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:37:18.860053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9fdfdc96-a347-4b5a-a55c-693806e18b3a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:18.860674 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9fdfdc96-a347-4b5a-a55c-693806e18b3a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 0f771edb-4a7d-4509-b58f-af57c6e1d6d8] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:18.867887 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fdfdc96-a347-4b5a-a55c-693806e18b3a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:18.868368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fdfdc96-a347-4b5a-a55c-693806e18b3a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:18.868802 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fdfdc96-a347-4b5a-a55c-693806e18b3a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:18.869501 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fdfdc96-a347-4b5a-a55c-693806e18b3a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:18.869956 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fdfdc96-a347-4b5a-a55c-693806e18b3a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:18.870410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fdfdc96-a347-4b5a-a55c-693806e18b3a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:18.873117 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:18.886574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-9fdfdc96-a347-4b5a-a55c-693806e18b3a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9fdfdc96-a347-4b5a-a55c-693806e18b3a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 HTTP/1.1 Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:37:18.888274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:37:18.889922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:37:18.889922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:18.889922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:18.889922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:18.889922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:18.889922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:37:18.889922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:37:18.889922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:37:18.889922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:18.889922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:37:18.889922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:18.889922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '0f771edb-4a7d-4509-b58f-af57c6e1d6d8'} Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:37:18.891012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. Aug 08 02:37:18.892574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:18.893829 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9fdfdc96-a347-4b5a-a55c-693806e18b3a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 404 to user: Instance 0f771edb-4a7d-4509-b58f-af57c6e1d6d8 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:37:18.893829 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9fdfdc96-a347-4b5a-a55c-693806e18b3a tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8" status: 404 len: 111 microversion: 2.1 time: 0.033720 Aug 08 02:37:18.893829 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 509/1030] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:18 2022] GET /compute/v2.1/servers/0f771edb-4a7d-4509-b58f-af57c6e1d6d8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:37:18.931994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f507aa28-5b21-4098-8ff2-d047d44a0a02 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:18.932603 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f507aa28-5b21-4098-8ff2-d047d44a0a02 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:18.938675 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f507aa28-5b21-4098-8ff2-d047d44a0a02 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:18.939251 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f507aa28-5b21-4098-8ff2-d047d44a0a02 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:18.939717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f507aa28-5b21-4098-8ff2-d047d44a0a02 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:18.940707 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f507aa28-5b21-4098-8ff2-d047d44a0a02 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:18.941152 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f507aa28-5b21-4098-8ff2-d047d44a0a02 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:18.941619 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f507aa28-5b21-4098-8ff2-d047d44a0a02 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:19.080996 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f507aa28-5b21-4098-8ff2-d047d44a0a02 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:19.091132 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f507aa28-5b21-4098-8ff2-d047d44a0a02 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:19.092636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f507aa28-5b21-4098-8ff2-d047d44a0a02 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:19.093790 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f507aa28-5b21-4098-8ff2-d047d44a0a02 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1808 microversion: 2.20 time: 0.166638 Aug 08 02:37:19.094359 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 522/1031] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:18 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:37:20.035659 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-811417b2-4cf2-46ed-bb63-77b0b71560e5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:20.036145 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-811417b2-4cf2-46ed-bb63-77b0b71560e5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:20.043503 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-811417b2-4cf2-46ed-bb63-77b0b71560e5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:20.043944 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-811417b2-4cf2-46ed-bb63-77b0b71560e5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:20.044375 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-811417b2-4cf2-46ed-bb63-77b0b71560e5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:20.045136 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-811417b2-4cf2-46ed-bb63-77b0b71560e5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:20.045585 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-811417b2-4cf2-46ed-bb63-77b0b71560e5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:20.046017 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-811417b2-4cf2-46ed-bb63-77b0b71560e5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:20.060737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-811417b2-4cf2-46ed-bb63-77b0b71560e5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-811417b2-4cf2-46ed-bb63-77b0b71560e5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef HTTP/1.1 Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:37:20.062382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:37:20.064034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:37:20.064034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:20.064034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:20.064034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:20.064034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:20.064034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:37:20.064034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:37:20.064034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:37:20.064034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:20.064034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:37:20.064034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:37:20.064034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '68078741-87cd-4d1a-a760-fbc0dd0f29ef'} Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:37:20.065809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:37:20.067797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.069368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-811417b2-4cf2-46ed-bb63-77b0b71560e5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 404 to user: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:37:20.069368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-811417b2-4cf2-46ed-bb63-77b0b71560e5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 404 len: 111 microversion: 2.1 time: 0.032006 Aug 08 02:37:20.069368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 510/1032] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:37:20 2022] DELETE /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:37:20.073396 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-727d8017-2dac-469f-ad88-97a4e05e06a5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:20.073998 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-727d8017-2dac-469f-ad88-97a4e05e06a5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 68078741-87cd-4d1a-a760-fbc0dd0f29ef] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:20.080331 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-727d8017-2dac-469f-ad88-97a4e05e06a5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:20.080808 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-727d8017-2dac-469f-ad88-97a4e05e06a5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:20.081474 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-727d8017-2dac-469f-ad88-97a4e05e06a5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:20.081900 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-727d8017-2dac-469f-ad88-97a4e05e06a5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:20.082527 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-727d8017-2dac-469f-ad88-97a4e05e06a5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:20.082778 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-727d8017-2dac-469f-ad88-97a4e05e06a5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:20.096197 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-727d8017-2dac-469f-ad88-97a4e05e06a5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-727d8017-2dac-469f-ad88-97a4e05e06a5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef HTTP/1.1 Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:37:20.097834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:37:20.100495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:37:20.100495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:20.100495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:20.100495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:20.100495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:20.100495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:37:20.100495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:37:20.100495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:37:20.100495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:20.100495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:37:20.100495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:37:20.100495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '68078741-87cd-4d1a-a760-fbc0dd0f29ef'} Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:37:20.101454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. Aug 08 02:37:20.104121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.106805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-727d8017-2dac-469f-ad88-97a4e05e06a5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 404 to user: Instance 68078741-87cd-4d1a-a760-fbc0dd0f29ef could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:37:20.106805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-727d8017-2dac-469f-ad88-97a4e05e06a5 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef" status: 404 len: 111 microversion: 2.1 time: 0.029641 Aug 08 02:37:20.106805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 523/1033] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:20 2022] GET /compute/v2.1/servers/68078741-87cd-4d1a-a760-fbc0dd0f29ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:37:20.108488 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bc829197-eb98-43ab-81e1-7463ebc1bc8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:20.109014 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bc829197-eb98-43ab-81e1-7463ebc1bc8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:20.118656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc829197-eb98-43ab-81e1-7463ebc1bc8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:20.118656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc829197-eb98-43ab-81e1-7463ebc1bc8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:20.118656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc829197-eb98-43ab-81e1-7463ebc1bc8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:20.118656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc829197-eb98-43ab-81e1-7463ebc1bc8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:20.119243 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-41197769-5bdb-41d8-877d-07a3a24ea1ee tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:20.119442 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc829197-eb98-43ab-81e1-7463ebc1bc8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:20.119442 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc829197-eb98-43ab-81e1-7463ebc1bc8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:20.119748 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-41197769-5bdb-41d8-877d-07a3a24ea1ee tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:20.127406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41197769-5bdb-41d8-877d-07a3a24ea1ee tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:20.127406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41197769-5bdb-41d8-877d-07a3a24ea1ee tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:20.127406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41197769-5bdb-41d8-877d-07a3a24ea1ee tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:20.128499 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41197769-5bdb-41d8-877d-07a3a24ea1ee tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:20.128690 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41197769-5bdb-41d8-877d-07a3a24ea1ee tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:20.129025 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41197769-5bdb-41d8-877d-07a3a24ea1ee tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:20.141366 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-bc829197-eb98-43ab-81e1-7463ebc1bc8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bc829197-eb98-43ab-81e1-7463ebc1bc8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d HTTP/1.1 Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:37:20.143175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:37:20.144519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:37:20.144519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:20.144519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:20.144519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:20.144519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:20.144519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:37:20.144519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:37:20.144519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:37:20.144519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:20.144519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:37:20.144519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:37:20.144519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '618e3559-1b3a-43a9-aede-202dbd418c4d'} Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:37:20.145359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:37:20.146679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.147907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bc829197-eb98-43ab-81e1-7463ebc1bc8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 404 to user: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:37:20.147907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bc829197-eb98-43ab-81e1-7463ebc1bc8f tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 404 len: 111 microversion: 2.1 time: 0.040404 Aug 08 02:37:20.147907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 511/1034] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:37:20 2022] DELETE /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:37:20.160435 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-842a0104-b76c-4d65-85c5-6fe6c29bcb70 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:20.161103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-842a0104-b76c-4d65-85c5-6fe6c29bcb70 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: 618e3559-1b3a-43a9-aede-202dbd418c4d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:20.167941 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-842a0104-b76c-4d65-85c5-6fe6c29bcb70 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:20.168444 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-842a0104-b76c-4d65-85c5-6fe6c29bcb70 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:20.168882 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-842a0104-b76c-4d65-85c5-6fe6c29bcb70 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:20.169607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-842a0104-b76c-4d65-85c5-6fe6c29bcb70 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:20.170066 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-842a0104-b76c-4d65-85c5-6fe6c29bcb70 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:20.170510 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-842a0104-b76c-4d65-85c5-6fe6c29bcb70 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:20.184832 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-842a0104-b76c-4d65-85c5-6fe6c29bcb70 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-842a0104-b76c-4d65-85c5-6fe6c29bcb70 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d HTTP/1.1 Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:37:20.186465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:37:20.187761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:37:20.187761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:20.187761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:20.187761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:20.187761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:20.187761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:37:20.187761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:37:20.187761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:37:20.187761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:20.187761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:37:20.187761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:37:20.187761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '618e3559-1b3a-43a9-aede-202dbd418c4d'} Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:37:20.188493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. Aug 08 02:37:20.189669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:20.191144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-842a0104-b76c-4d65-85c5-6fe6c29bcb70 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 404 to user: Instance 618e3559-1b3a-43a9-aede-202dbd418c4d could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:37:20.191144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-842a0104-b76c-4d65-85c5-6fe6c29bcb70 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d" status: 404 len: 111 microversion: 2.1 time: 0.031660 Aug 08 02:37:20.191144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 512/1035] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:20 2022] GET /compute/v2.1/servers/618e3559-1b3a-43a9-aede-202dbd418c4d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:37:20.275391 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-41197769-5bdb-41d8-877d-07a3a24ea1ee tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:20.284354 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-41197769-5bdb-41d8-877d-07a3a24ea1ee tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:20.286669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-41197769-5bdb-41d8-877d-07a3a24ea1ee tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:37:20.288416 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-41197769-5bdb-41d8-877d-07a3a24ea1ee tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1795 microversion: 2.20 time: 0.175231 Aug 08 02:37:20.288951 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 524/1036] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:37:20 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1795 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:37:21.330727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2e104170-b29e-4e77-8fc5-0310261692be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:21.331348 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2e104170-b29e-4e77-8fc5-0310261692be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:21.338364 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e104170-b29e-4e77-8fc5-0310261692be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:21.338928 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e104170-b29e-4e77-8fc5-0310261692be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:21.339442 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e104170-b29e-4e77-8fc5-0310261692be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:21.340223 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e104170-b29e-4e77-8fc5-0310261692be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:21.340848 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e104170-b29e-4e77-8fc5-0310261692be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:21.341267 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2e104170-b29e-4e77-8fc5-0310261692be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:21.355763 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-2e104170-b29e-4e77-8fc5-0310261692be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2e104170-b29e-4e77-8fc5-0310261692be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e HTTP/1.1 Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:37:21.357212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:37:21.358684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:37:21.358684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:21.358684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:21.358684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:21.358684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:21.358684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:37:21.358684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:37:21.358684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:37:21.358684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:21.358684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:37:21.358684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:37:21.358684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': 'b4568714-ae5a-47eb-9140-be5702dd288e'} Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:37:21.359601 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:37:21.361072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:37:21.362668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2e104170-b29e-4e77-8fc5-0310261692be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 404 to user: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:37:21.362668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2e104170-b29e-4e77-8fc5-0310261692be tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 404 len: 111 microversion: 2.1 time: 0.032054 Aug 08 02:37:21.362668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 513/1037] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:37:21 2022] DELETE /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:37:21.367383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-72967d80-09f2-4971-92bf-803cd6517fd6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:37:21.368142 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-72967d80-09f2-4971-92bf-803cd6517fd6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] [instance: b4568714-ae5a-47eb-9140-be5702dd288e] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:37:21.374263 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72967d80-09f2-4971-92bf-803cd6517fd6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:21.374772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72967d80-09f2-4971-92bf-803cd6517fd6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:21.375205 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72967d80-09f2-4971-92bf-803cd6517fd6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:21.375923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72967d80-09f2-4971-92bf-803cd6517fd6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:37:21.376563 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72967d80-09f2-4971-92bf-803cd6517fd6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:37:21.376970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-72967d80-09f2-4971-92bf-803cd6517fd6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:37:21.391942 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-72967d80-09f2-4971-92bf-803cd6517fd6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] HTTP exception thrown: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-72967d80-09f2-4971-92bf-803cd6517fd6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Request method failure captured: Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e HTTP/1.1 Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HQeijX8FKXlhB0-Dwdov9AbIujHCYkqRa6Qpit576efckf-j1JAXNp0MRN5VBjoXUY5dYK7Vk554P6ZAEL7K3oPCqcsEjSEcVG9HMRskS69WXJ0ZsIkcSYeNQinRHnG6uqDtzX4v6Vy9xkNcBuKh8a6wG0P1Cl4XAABvCGSJQFI8n8 Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:37:21.393546 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:37:21.394970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3c533d28fa3f4d11b88b630a7c7bd1b4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3c533d28fa3f4d11b88b630a7c7bd1b4"}]}] Aug 08 02:37:21.394970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:21.394970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 3c533d28fa3f4d11b88b630a7c7bd1b4 Aug 08 02:37:21.394970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-86495873 Aug 08 02:37:21.394970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:21.394970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:37:21.394970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:37:21.394970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 43dd72b161f8442285dea411741d66b3 Aug 08 02:37:21.394970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeNegativeTest-86495873-project Aug 08 02:37:21.394970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:37:21.394970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:37:21.394970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': 'b4568714-ae5a-47eb-9140-be5702dd288e'} Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:37:21.395751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. Aug 08 02:37:21.397910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:37:21.399023 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-72967d80-09f2-4971-92bf-803cd6517fd6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] Returning 404 to user: Instance b4568714-ae5a-47eb-9140-be5702dd288e could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:37:21.399023 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-72967d80-09f2-4971-92bf-803cd6517fd6 tempest-AttachVolumeNegativeTest-86495873 tempest-AttachVolumeNegativeTest-86495873-project] 10.222.0.39 "GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e" status: 404 len: 111 microversion: 2.1 time: 0.031444 Aug 08 02:37:21.399023 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 525/1038] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:37:21 2022] GET /compute/v2.1/servers/b4568714-ae5a-47eb-9140-be5702dd288e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:37:23.501670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:37:23.503952 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Mon Aug 8 02:37:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:37:32.860661 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:32.861425 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=9 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:37:33.068764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e8697d5d-053d-4b50-a8cd-9122993a70a2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Action: 'create', calling method: .version_select at 0x7f3295c44ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-819876671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9lb27esYTX9poBHuOCYC5utI+g4QLtyecfG+4giNeHYCWwjMyKZxMprhm0uDYhAhD802pPWEcWfI8nSiv1lYKtSMoCeGj4LnL4xsKNC/BXEBlnyJCdwOQD8+2WEu5kaQ=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:37:33.085502 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-e8697d5d-053d-4b50-a8cd-9122993a70a2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Getting quotas for project 7a06a8947bd84ac398bf498d8816717c. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:37:33.089714 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-e8697d5d-053d-4b50-a8cd-9122993a70a2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Getting quotas for user 72485bc9ed6f4684b77b617597f99e29 and project 7a06a8947bd84ac398bf498d8816717c. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:37:33.113222 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e8697d5d-053d-4b50-a8cd-9122993a70a2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.259557 Aug 08 02:37:33.113832 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 514/1039] 10.222.0.39 () {60 vars in 1159 bytes} [Mon Aug 8 02:37:32 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:38:03.175030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-570984218", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-819876671", "security_groups": [{"name": "tempest-secgroup-smoke-357897792"}], "block_device_mapping_v2": [{"uuid": "69505825-13b6-4fe2-8e9b-d728ffa5c84a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a2a67ad0-5293-4294-ac4f-5a74fbe89f5a"}]}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:38:03.184851 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:03.185481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=55 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:03.289606 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.network.neutron [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] validate_networks() for [('a2a67ad0-5293-4294-ac4f-5a74fbe89f5a', None, None, None, None, None)] {{(pid=117640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:38:03.748155 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Flavor limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:38:03.748574 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Image limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:38:03.749039 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Flavor pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:38:03.749446 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Image pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:38:03.749848 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:38:03.758623 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:03.759095 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:03.759517 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:03.760826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:03.761270 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:03.761684 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:03.779203 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Getting quotas for project 7a06a8947bd84ac398bf498d8816717c. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:38:03.783151 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Getting quotas for user 72485bc9ed6f4684b77b617597f99e29 and project 7a06a8947bd84ac398bf498d8816717c. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:38:03.840502 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Going to run 1 instances... {{(pid=117640) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:38:03.842625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69505825-13b6-4fe2-8e9b-d728ffa5c84a',volume_size=None,volume_type=None)] {{(pid=117640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:38:03.972032 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-529f5a67-c10f-4c4d-83dd-377f44bc871f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.800743 Aug 08 02:38:03.972656 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 526/1040] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:38:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:38:03.981502 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:03.982437 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:03.986129 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a19e82b-6db2-48d4-b17b-53a0070f1853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:03.986767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a19e82b-6db2-48d4-b17b-53a0070f1853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:04.044904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a19e82b-6db2-48d4-b17b-53a0070f1853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:04.051907 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a19e82b-6db2-48d4-b17b-53a0070f1853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1093 microversion: 2.1 time: 0.071774 Aug 08 02:38:04.052736 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 515/1041] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:03 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:05.073495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-41d2e945-0b1d-4608-99b8-80666a3eecbb tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:05.074238 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-41d2e945-0b1d-4608-99b8-80666a3eecbb tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:05.080969 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41d2e945-0b1d-4608-99b8-80666a3eecbb tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:05.081522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41d2e945-0b1d-4608-99b8-80666a3eecbb tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:05.082037 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41d2e945-0b1d-4608-99b8-80666a3eecbb tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:05.082952 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41d2e945-0b1d-4608-99b8-80666a3eecbb tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:05.083404 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41d2e945-0b1d-4608-99b8-80666a3eecbb tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:05.083827 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41d2e945-0b1d-4608-99b8-80666a3eecbb tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:05.163042 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-41d2e945-0b1d-4608-99b8-80666a3eecbb tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:05.171068 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-41d2e945-0b1d-4608-99b8-80666a3eecbb tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1209 microversion: 2.1 time: 0.102690 Aug 08 02:38:05.171608 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 527/1042] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:05 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1209 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:06.191572 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8e79aac3-1337-41d9-b3d3-84734b4b8367 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:06.192131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8e79aac3-1337-41d9-b3d3-84734b4b8367 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:06.198513 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e79aac3-1337-41d9-b3d3-84734b4b8367 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:06.198994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e79aac3-1337-41d9-b3d3-84734b4b8367 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:06.199421 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e79aac3-1337-41d9-b3d3-84734b4b8367 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:06.200103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e79aac3-1337-41d9-b3d3-84734b4b8367 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:06.200552 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e79aac3-1337-41d9-b3d3-84734b4b8367 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:06.200967 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e79aac3-1337-41d9-b3d3-84734b4b8367 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:06.333329 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8e79aac3-1337-41d9-b3d3-84734b4b8367 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:06.341038 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8e79aac3-1337-41d9-b3d3-84734b4b8367 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.153894 Aug 08 02:38:06.341605 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 516/1043] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:06 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:06.656888 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-4ca98a6a-2920-4ba1-99d2-16bd512d27ec req-ab0daab6-8d48-4c88-bc1e-e3ea5963dbed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eee5906-f8e7-4294-8d31-0a12e9a69bb0", "tag": "493db5d9-4de4-48ec-81f6-b22bbf117145"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:38:06.671843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-4ca98a6a-2920-4ba1-99d2-16bd512d27ec req-ab0daab6-8d48-4c88-bc1e-e3ea5963dbed service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:06.672322 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-4ca98a6a-2920-4ba1-99d2-16bd512d27ec req-ab0daab6-8d48-4c88-bc1e-e3ea5963dbed service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:06.672750 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-4ca98a6a-2920-4ba1-99d2-16bd512d27ec req-ab0daab6-8d48-4c88-bc1e-e3ea5963dbed service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:06.685829 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-4ca98a6a-2920-4ba1-99d2-16bd512d27ec req-ab0daab6-8d48-4c88-bc1e-e3ea5963dbed service nova] Creating event network-changed:493db5d9-4de4-48ec-81f6-b22bbf117145 for instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 on hv-cinder-73306 Aug 08 02:38:06.694002 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-4ca98a6a-2920-4ba1-99d2-16bd512d27ec req-ab0daab6-8d48-4c88-bc1e-e3ea5963dbed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041893 Aug 08 02:38:06.694626 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 528/1044] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:38:07.362218 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6407c152-f693-4322-97a7-0909f54ea8e3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:07.362871 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6407c152-f693-4322-97a7-0909f54ea8e3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:07.369208 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6407c152-f693-4322-97a7-0909f54ea8e3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:07.369789 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6407c152-f693-4322-97a7-0909f54ea8e3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:07.370224 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6407c152-f693-4322-97a7-0909f54ea8e3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:07.370929 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6407c152-f693-4322-97a7-0909f54ea8e3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:07.371382 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6407c152-f693-4322-97a7-0909f54ea8e3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:07.371804 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6407c152-f693-4322-97a7-0909f54ea8e3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:07.500900 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6407c152-f693-4322-97a7-0909f54ea8e3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:07.508305 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6407c152-f693-4322-97a7-0909f54ea8e3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.149954 Aug 08 02:38:07.508873 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 517/1045] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:07 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:08.529976 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0b2530f2-f11b-4316-92b0-d928a3590e44 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:08.530692 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0b2530f2-f11b-4316-92b0-d928a3590e44 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:08.536836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b2530f2-f11b-4316-92b0-d928a3590e44 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:08.537313 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b2530f2-f11b-4316-92b0-d928a3590e44 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:08.537741 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b2530f2-f11b-4316-92b0-d928a3590e44 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:08.538518 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b2530f2-f11b-4316-92b0-d928a3590e44 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:08.538967 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b2530f2-f11b-4316-92b0-d928a3590e44 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:08.539385 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b2530f2-f11b-4316-92b0-d928a3590e44 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:08.672965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0b2530f2-f11b-4316-92b0-d928a3590e44 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:08.680329 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0b2530f2-f11b-4316-92b0-d928a3590e44 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.155082 Aug 08 02:38:08.680965 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 529/1046] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:08 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:38:09.701608 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a6144671-2558-4a8d-9d67-73d642e5dd2d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:09.702166 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a6144671-2558-4a8d-9d67-73d642e5dd2d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:09.708590 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6144671-2558-4a8d-9d67-73d642e5dd2d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:09.709067 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6144671-2558-4a8d-9d67-73d642e5dd2d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:09.709502 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6144671-2558-4a8d-9d67-73d642e5dd2d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:09.710184 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6144671-2558-4a8d-9d67-73d642e5dd2d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:09.710668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6144671-2558-4a8d-9d67-73d642e5dd2d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:09.711088 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6144671-2558-4a8d-9d67-73d642e5dd2d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:09.843277 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a6144671-2558-4a8d-9d67-73d642e5dd2d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:09.850494 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a6144671-2558-4a8d-9d67-73d642e5dd2d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.153373 Aug 08 02:38:09.851064 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 518/1047] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:09 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:10.872064 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-64600472-23b9-49be-92e0-cf557ba1f166 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:10.872703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-64600472-23b9-49be-92e0-cf557ba1f166 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:10.879211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-64600472-23b9-49be-92e0-cf557ba1f166 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:10.879688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-64600472-23b9-49be-92e0-cf557ba1f166 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:10.880119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-64600472-23b9-49be-92e0-cf557ba1f166 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:10.880801 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-64600472-23b9-49be-92e0-cf557ba1f166 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:10.881251 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-64600472-23b9-49be-92e0-cf557ba1f166 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:10.881671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-64600472-23b9-49be-92e0-cf557ba1f166 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:11.082165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-64600472-23b9-49be-92e0-cf557ba1f166 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:11.090262 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-64600472-23b9-49be-92e0-cf557ba1f166 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.222641 Aug 08 02:38:11.090933 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 530/1048] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:10 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:38:12.111018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8ab50bba-68b3-4da0-a665-f5fb73f3c2c5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:12.111568 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8ab50bba-68b3-4da0-a665-f5fb73f3c2c5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:12.117836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab50bba-68b3-4da0-a665-f5fb73f3c2c5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:12.118340 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab50bba-68b3-4da0-a665-f5fb73f3c2c5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:12.118766 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab50bba-68b3-4da0-a665-f5fb73f3c2c5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:12.120048 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab50bba-68b3-4da0-a665-f5fb73f3c2c5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:12.120510 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab50bba-68b3-4da0-a665-f5fb73f3c2c5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:12.120925 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab50bba-68b3-4da0-a665-f5fb73f3c2c5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:12.249549 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ab50bba-68b3-4da0-a665-f5fb73f3c2c5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:12.257318 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8ab50bba-68b3-4da0-a665-f5fb73f3c2c5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.150132 Aug 08 02:38:12.258109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 519/1049] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:12 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:13.276806 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e43706da-06fb-4a51-a3d7-cb6f7d1cc718 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:13.277417 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e43706da-06fb-4a51-a3d7-cb6f7d1cc718 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:13.283773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e43706da-06fb-4a51-a3d7-cb6f7d1cc718 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:13.284249 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e43706da-06fb-4a51-a3d7-cb6f7d1cc718 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:13.284682 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e43706da-06fb-4a51-a3d7-cb6f7d1cc718 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:13.285364 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e43706da-06fb-4a51-a3d7-cb6f7d1cc718 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:13.285814 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e43706da-06fb-4a51-a3d7-cb6f7d1cc718 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:13.286232 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e43706da-06fb-4a51-a3d7-cb6f7d1cc718 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:13.414400 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e43706da-06fb-4a51-a3d7-cb6f7d1cc718 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:13.421977 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e43706da-06fb-4a51-a3d7-cb6f7d1cc718 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.148998 Aug 08 02:38:13.422567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 531/1050] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:13 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:14.443406 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3bae4c86-39ba-4e30-8643-c8c1b674f771 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:14.443941 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3bae4c86-39ba-4e30-8643-c8c1b674f771 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:14.446031 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:14.452181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bae4c86-39ba-4e30-8643-c8c1b674f771 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:14.452661 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bae4c86-39ba-4e30-8643-c8c1b674f771 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:14.453092 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bae4c86-39ba-4e30-8643-c8c1b674f771 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:14.453776 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bae4c86-39ba-4e30-8643-c8c1b674f771 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:14.454270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bae4c86-39ba-4e30-8643-c8c1b674f771 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:14.454691 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bae4c86-39ba-4e30-8643-c8c1b674f771 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:14.599933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3bae4c86-39ba-4e30-8643-c8c1b674f771 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:14.608509 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3bae4c86-39ba-4e30-8643-c8c1b674f771 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.169451 Aug 08 02:38:14.609098 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 520/1051] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:14 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:15.630870 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d1b417b5-6a11-481c-bb6e-5d7b9fdcb147 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:15.631494 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d1b417b5-6a11-481c-bb6e-5d7b9fdcb147 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:15.633419 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:15.634070 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=6 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:15.640074 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d1b417b5-6a11-481c-bb6e-5d7b9fdcb147 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:15.640544 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d1b417b5-6a11-481c-bb6e-5d7b9fdcb147 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:15.640969 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d1b417b5-6a11-481c-bb6e-5d7b9fdcb147 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:15.641642 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d1b417b5-6a11-481c-bb6e-5d7b9fdcb147 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:15.642092 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d1b417b5-6a11-481c-bb6e-5d7b9fdcb147 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:15.642846 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d1b417b5-6a11-481c-bb6e-5d7b9fdcb147 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:15.776766 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d1b417b5-6a11-481c-bb6e-5d7b9fdcb147 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:15.784088 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d1b417b5-6a11-481c-bb6e-5d7b9fdcb147 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.157052 Aug 08 02:38:15.784648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 532/1052] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:15 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:16.804438 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6308f258-3b97-4844-a18d-2212ee6ec94b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:16.805068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6308f258-3b97-4844-a18d-2212ee6ec94b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:16.811531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6308f258-3b97-4844-a18d-2212ee6ec94b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:16.812009 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6308f258-3b97-4844-a18d-2212ee6ec94b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:16.812438 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6308f258-3b97-4844-a18d-2212ee6ec94b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:16.813189 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6308f258-3b97-4844-a18d-2212ee6ec94b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:16.813642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6308f258-3b97-4844-a18d-2212ee6ec94b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:16.814060 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6308f258-3b97-4844-a18d-2212ee6ec94b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:16.949472 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6308f258-3b97-4844-a18d-2212ee6ec94b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:16.956878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6308f258-3b97-4844-a18d-2212ee6ec94b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.156327 Aug 08 02:38:16.957440 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 521/1053] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:16 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:17.977038 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d9cd0357-8e48-4eca-a8f7-22a5d46c879d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:17.977630 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d9cd0357-8e48-4eca-a8f7-22a5d46c879d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:17.984797 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d9cd0357-8e48-4eca-a8f7-22a5d46c879d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:17.985272 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d9cd0357-8e48-4eca-a8f7-22a5d46c879d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:17.985701 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d9cd0357-8e48-4eca-a8f7-22a5d46c879d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:17.986418 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d9cd0357-8e48-4eca-a8f7-22a5d46c879d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:17.986869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d9cd0357-8e48-4eca-a8f7-22a5d46c879d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:17.987290 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d9cd0357-8e48-4eca-a8f7-22a5d46c879d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:18.114819 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d9cd0357-8e48-4eca-a8f7-22a5d46c879d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:18.122888 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d9cd0357-8e48-4eca-a8f7-22a5d46c879d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.149669 Aug 08 02:38:18.123447 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 533/1054] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:17 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:19.143223 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c10d6fcd-bde1-4add-a728-ad4275fa211a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:19.143835 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c10d6fcd-bde1-4add-a728-ad4275fa211a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:19.150737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c10d6fcd-bde1-4add-a728-ad4275fa211a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:19.151219 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c10d6fcd-bde1-4add-a728-ad4275fa211a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:19.151650 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c10d6fcd-bde1-4add-a728-ad4275fa211a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:19.152333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c10d6fcd-bde1-4add-a728-ad4275fa211a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:19.152785 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c10d6fcd-bde1-4add-a728-ad4275fa211a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:19.153213 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c10d6fcd-bde1-4add-a728-ad4275fa211a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:19.281820 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c10d6fcd-bde1-4add-a728-ad4275fa211a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:19.289326 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c10d6fcd-bde1-4add-a728-ad4275fa211a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.149934 Aug 08 02:38:19.289901 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 522/1055] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:19 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:38:20.310124 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f27768f8-d1c2-4675-90ee-7b163f834b3d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:20.310753 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f27768f8-d1c2-4675-90ee-7b163f834b3d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:20.317318 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f27768f8-d1c2-4675-90ee-7b163f834b3d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:20.317792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f27768f8-d1c2-4675-90ee-7b163f834b3d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:20.318215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f27768f8-d1c2-4675-90ee-7b163f834b3d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:20.318918 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f27768f8-d1c2-4675-90ee-7b163f834b3d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:20.319641 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f27768f8-d1c2-4675-90ee-7b163f834b3d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:20.320068 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f27768f8-d1c2-4675-90ee-7b163f834b3d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:20.457568 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-f27768f8-d1c2-4675-90ee-7b163f834b3d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:20.465131 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f27768f8-d1c2-4675-90ee-7b163f834b3d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.159303 Aug 08 02:38:20.465678 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 534/1056] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:20 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:20.710626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-ca405720-f7e0-4184-aaa9-cf0ec1ebbf38 req-d76007e2-3658-4ee3-922a-6b1b30f025f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eee5906-f8e7-4294-8d31-0a12e9a69bb0", "name": "network-vif-plugged", "status": "completed", "tag": "493db5d9-4de4-48ec-81f6-b22bbf117145"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:38:20.721544 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ca405720-f7e0-4184-aaa9-cf0ec1ebbf38 req-d76007e2-3658-4ee3-922a-6b1b30f025f3 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:20.722154 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ca405720-f7e0-4184-aaa9-cf0ec1ebbf38 req-d76007e2-3658-4ee3-922a-6b1b30f025f3 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:20.722872 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ca405720-f7e0-4184-aaa9-cf0ec1ebbf38 req-d76007e2-3658-4ee3-922a-6b1b30f025f3 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:20.736042 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-ca405720-f7e0-4184-aaa9-cf0ec1ebbf38 req-d76007e2-3658-4ee3-922a-6b1b30f025f3 service nova] Creating event network-vif-plugged:493db5d9-4de4-48ec-81f6-b22bbf117145 for instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 on hv-cinder-73306 Aug 08 02:38:20.741230 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-ca405720-f7e0-4184-aaa9-cf0ec1ebbf38 req-d76007e2-3658-4ee3-922a-6b1b30f025f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034996 Aug 08 02:38:20.742223 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 523/1057] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:38:21.484760 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-afef548b-df01-4c5f-8b3f-4f854fd6cb50 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:21.485366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-afef548b-df01-4c5f-8b3f-4f854fd6cb50 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:21.491831 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afef548b-df01-4c5f-8b3f-4f854fd6cb50 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:21.492300 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afef548b-df01-4c5f-8b3f-4f854fd6cb50 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:21.492720 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afef548b-df01-4c5f-8b3f-4f854fd6cb50 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:21.493390 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afef548b-df01-4c5f-8b3f-4f854fd6cb50 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:21.493833 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afef548b-df01-4c5f-8b3f-4f854fd6cb50 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:21.494755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afef548b-df01-4c5f-8b3f-4f854fd6cb50 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:21.623261 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-afef548b-df01-4c5f-8b3f-4f854fd6cb50 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:21.630606 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-afef548b-df01-4c5f-8b3f-4f854fd6cb50 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1264 microversion: 2.1 time: 0.149706 Aug 08 02:38:21.631165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 535/1058] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:21 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:22.653578 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3011ff8b-4b9f-4065-b4e9-2a657026ce8c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:22.654286 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3011ff8b-4b9f-4065-b4e9-2a657026ce8c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:22.660358 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3011ff8b-4b9f-4065-b4e9-2a657026ce8c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:22.660833 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3011ff8b-4b9f-4065-b4e9-2a657026ce8c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:22.661258 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3011ff8b-4b9f-4065-b4e9-2a657026ce8c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:22.661931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3011ff8b-4b9f-4065-b4e9-2a657026ce8c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:22.662410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3011ff8b-4b9f-4065-b4e9-2a657026ce8c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:22.662846 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3011ff8b-4b9f-4065-b4e9-2a657026ce8c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:22.793337 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3011ff8b-4b9f-4065-b4e9-2a657026ce8c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:22.800719 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3011ff8b-4b9f-4065-b4e9-2a657026ce8c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1450 microversion: 2.1 time: 0.152424 Aug 08 02:38:22.801280 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 524/1059] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:22 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:38:22.820860 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4545b76c-f0ad-40d1-ad1d-02f94c596c11 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:22.821461 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4545b76c-f0ad-40d1-ad1d-02f94c596c11 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:22.828324 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4545b76c-f0ad-40d1-ad1d-02f94c596c11 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:22.828789 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4545b76c-f0ad-40d1-ad1d-02f94c596c11 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:22.829214 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4545b76c-f0ad-40d1-ad1d-02f94c596c11 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:22.829882 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4545b76c-f0ad-40d1-ad1d-02f94c596c11 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:22.830368 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4545b76c-f0ad-40d1-ad1d-02f94c596c11 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:22.830788 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4545b76c-f0ad-40d1-ad1d-02f94c596c11 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:22.958272 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4545b76c-f0ad-40d1-ad1d-02f94c596c11 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:22.966171 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4545b76c-f0ad-40d1-ad1d-02f94c596c11 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1450 microversion: 2.1 time: 0.149207 Aug 08 02:38:22.966749 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 536/1060] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:38:22 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1450 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:24.656743 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-68e62bb0-a75d-468d-930f-13fb4a5c58bc req-dd673a7f-7398-4aec-8874-541046868ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eee5906-f8e7-4294-8d31-0a12e9a69bb0", "tag": "493db5d9-4de4-48ec-81f6-b22bbf117145"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:38:24.669289 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-68e62bb0-a75d-468d-930f-13fb4a5c58bc req-dd673a7f-7398-4aec-8874-541046868ffe service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:24.669775 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-68e62bb0-a75d-468d-930f-13fb4a5c58bc req-dd673a7f-7398-4aec-8874-541046868ffe service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:24.670203 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-68e62bb0-a75d-468d-930f-13fb4a5c58bc req-dd673a7f-7398-4aec-8874-541046868ffe service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:24.683098 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-68e62bb0-a75d-468d-930f-13fb4a5c58bc req-dd673a7f-7398-4aec-8874-541046868ffe service nova] Creating event network-changed:493db5d9-4de4-48ec-81f6-b22bbf117145 for instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 on hv-cinder-73306 Aug 08 02:38:24.688637 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-68e62bb0-a75d-468d-930f-13fb4a5c58bc req-dd673a7f-7398-4aec-8874-541046868ffe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035533 Aug 08 02:38:24.689669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 525/1061] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:38:53.634677 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-73de157e-96c3-4fcc-8ea2-2b001172259e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:53.635259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-73de157e-96c3-4fcc-8ea2-2b001172259e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:53.637327 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:53.637971 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=58 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:53.644100 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-73de157e-96c3-4fcc-8ea2-2b001172259e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:53.644573 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-73de157e-96c3-4fcc-8ea2-2b001172259e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:53.645007 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-73de157e-96c3-4fcc-8ea2-2b001172259e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:53.645688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-73de157e-96c3-4fcc-8ea2-2b001172259e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:53.646144 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-73de157e-96c3-4fcc-8ea2-2b001172259e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:53.646589 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-73de157e-96c3-4fcc-8ea2-2b001172259e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:53.676334 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-73de157e-96c3-4fcc-8ea2-2b001172259e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-volume_attachments/a1034732-be37-4c58-a6ea-ff989c204e34" status: 200 len: 194 microversion: 2.20 time: 0.045719 Aug 08 02:38:53.676903 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 537/1062] 10.222.0.39 () {60 vars in 1454 bytes} [Mon Aug 8 02:38:53 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-volume_attachments/a1034732-be37-4c58-a6ea-ff989c204e34 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:38:53.742686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=24 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:53.743499 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=52 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:38:53.747663 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3bf60e79-5238-48ed-9181-f3479aed06c1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:53.748247 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3bf60e79-5238-48ed-9181-f3479aed06c1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:53.755123 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bf60e79-5238-48ed-9181-f3479aed06c1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:53.755603 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bf60e79-5238-48ed-9181-f3479aed06c1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:53.756036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bf60e79-5238-48ed-9181-f3479aed06c1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:53.756771 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bf60e79-5238-48ed-9181-f3479aed06c1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:53.757224 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bf60e79-5238-48ed-9181-f3479aed06c1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:53.757646 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bf60e79-5238-48ed-9181-f3479aed06c1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:53.836401 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-3bf60e79-5238-48ed-9181-f3479aed06c1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lazy-loading 'services' on Instance uuid 614b1928-9870-453b-8bf7-7b21f36ed2be {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:38:53.907018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3bf60e79-5238-48ed-9181-f3479aed06c1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "DELETE /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-volume_attachments/a1034732-be37-4c58-a6ea-ff989c204e34" status: 202 len: 0 microversion: 2.20 time: 0.165598 Aug 08 02:38:53.908191 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 526/1063] 10.222.0.39 () {60 vars in 1457 bytes} [Mon Aug 8 02:38:53 2022] DELETE /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-volume_attachments/a1034732-be37-4c58-a6ea-ff989c204e34 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:38:53.916575 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f040fd87-3a51-486a-b62b-ee4db1e463d4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:53.918792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f040fd87-3a51-486a-b62b-ee4db1e463d4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:53.924659 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f040fd87-3a51-486a-b62b-ee4db1e463d4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:53.925182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f040fd87-3a51-486a-b62b-ee4db1e463d4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:53.925579 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f040fd87-3a51-486a-b62b-ee4db1e463d4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:53.926498 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f040fd87-3a51-486a-b62b-ee4db1e463d4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:53.926982 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f040fd87-3a51-486a-b62b-ee4db1e463d4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:53.927408 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f040fd87-3a51-486a-b62b-ee4db1e463d4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:53.956998 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f040fd87-3a51-486a-b62b-ee4db1e463d4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044303 Aug 08 02:38:53.957478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 538/1064] 10.222.0.39 () {60 vars in 1343 bytes} [Mon Aug 8 02:38:53 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:38:54.969843 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d91fef8c-d756-4fd1-9c45-5bd8f318fa96 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:54.972647 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d91fef8c-d756-4fd1-9c45-5bd8f318fa96 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:54.979227 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d91fef8c-d756-4fd1-9c45-5bd8f318fa96 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:54.979749 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d91fef8c-d756-4fd1-9c45-5bd8f318fa96 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:54.980185 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d91fef8c-d756-4fd1-9c45-5bd8f318fa96 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:54.980879 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d91fef8c-d756-4fd1-9c45-5bd8f318fa96 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:54.981332 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d91fef8c-d756-4fd1-9c45-5bd8f318fa96 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:54.981777 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d91fef8c-d756-4fd1-9c45-5bd8f318fa96 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:55.012626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d91fef8c-d756-4fd1-9c45-5bd8f318fa96 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047291 Aug 08 02:38:55.013178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 527/1065] 10.222.0.39 () {60 vars in 1343 bytes} [Mon Aug 8 02:38:54 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:38:56.024958 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e80b3b09-332f-4e8a-a55a-3701e4f12409 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:56.027152 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e80b3b09-332f-4e8a-a55a-3701e4f12409 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:56.033484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e80b3b09-332f-4e8a-a55a-3701e4f12409 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:56.033951 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e80b3b09-332f-4e8a-a55a-3701e4f12409 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:56.034748 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e80b3b09-332f-4e8a-a55a-3701e4f12409 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:56.035427 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e80b3b09-332f-4e8a-a55a-3701e4f12409 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:56.035872 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e80b3b09-332f-4e8a-a55a-3701e4f12409 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:56.036284 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e80b3b09-332f-4e8a-a55a-3701e4f12409 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:56.065356 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e80b3b09-332f-4e8a-a55a-3701e4f12409 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044114 Aug 08 02:38:56.065902 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 539/1066] 10.222.0.39 () {60 vars in 1343 bytes} [Mon Aug 8 02:38:56 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:38:56.128867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ce819e02-fa05-4cfe-a747-7d2fe37a16e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:56.129387 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ce819e02-fa05-4cfe-a747-7d2fe37a16e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:56.135783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce819e02-fa05-4cfe-a747-7d2fe37a16e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:56.136260 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce819e02-fa05-4cfe-a747-7d2fe37a16e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:56.136692 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce819e02-fa05-4cfe-a747-7d2fe37a16e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:56.137373 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce819e02-fa05-4cfe-a747-7d2fe37a16e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:56.137822 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce819e02-fa05-4cfe-a747-7d2fe37a16e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:56.138239 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ce819e02-fa05-4cfe-a747-7d2fe37a16e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:56.162474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ce819e02-fa05-4cfe-a747-7d2fe37a16e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:38:56.236746 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ce819e02-fa05-4cfe-a747-7d2fe37a16e9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "DELETE /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 204 len: 0 microversion: 2.20 time: 0.113298 Aug 08 02:38:56.237473 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 528/1067] 10.222.0.39 () {60 vars in 1280 bytes} [Mon Aug 8 02:38:56 2022] DELETE /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 02:38:56.245464 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c07bc99c-1245-4567-bbb8-d93d189f302c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:56.246322 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c07bc99c-1245-4567-bbb8-d93d189f302c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:56.252792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c07bc99c-1245-4567-bbb8-d93d189f302c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:56.253265 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c07bc99c-1245-4567-bbb8-d93d189f302c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:56.253695 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c07bc99c-1245-4567-bbb8-d93d189f302c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:56.254400 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c07bc99c-1245-4567-bbb8-d93d189f302c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:56.254852 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c07bc99c-1245-4567-bbb8-d93d189f302c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:56.255269 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c07bc99c-1245-4567-bbb8-d93d189f302c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:56.381424 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c07bc99c-1245-4567-bbb8-d93d189f302c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:56.389367 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c07bc99c-1245-4567-bbb8-d93d189f302c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:56.390901 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c07bc99c-1245-4567-bbb8-d93d189f302c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:56.392139 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c07bc99c-1245-4567-bbb8-d93d189f302c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.150413 Aug 08 02:38:56.392680 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 540/1068] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:56 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:38:57.415598 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9cc70e5a-4344-4340-af01-ee00ef94654d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:57.416302 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9cc70e5a-4344-4340-af01-ee00ef94654d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:57.422711 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cc70e5a-4344-4340-af01-ee00ef94654d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:57.423193 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cc70e5a-4344-4340-af01-ee00ef94654d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:57.423623 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cc70e5a-4344-4340-af01-ee00ef94654d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:57.424312 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cc70e5a-4344-4340-af01-ee00ef94654d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:57.424761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cc70e5a-4344-4340-af01-ee00ef94654d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:57.425181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9cc70e5a-4344-4340-af01-ee00ef94654d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:57.553421 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9cc70e5a-4344-4340-af01-ee00ef94654d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:57.563205 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9cc70e5a-4344-4340-af01-ee00ef94654d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:57.565884 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9cc70e5a-4344-4340-af01-ee00ef94654d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:57.567240 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9cc70e5a-4344-4340-af01-ee00ef94654d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.155990 Aug 08 02:38:57.567792 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 529/1069] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:57 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:58.589198 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b40f0244-07df-4d13-abbf-33093e757f87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:58.589776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b40f0244-07df-4d13-abbf-33093e757f87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:58.596987 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b40f0244-07df-4d13-abbf-33093e757f87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:58.597475 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b40f0244-07df-4d13-abbf-33093e757f87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:58.597911 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b40f0244-07df-4d13-abbf-33093e757f87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:58.598641 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b40f0244-07df-4d13-abbf-33093e757f87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:58.599099 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b40f0244-07df-4d13-abbf-33093e757f87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:58.599524 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b40f0244-07df-4d13-abbf-33093e757f87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:58.816692 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b40f0244-07df-4d13-abbf-33093e757f87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:58.824677 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b40f0244-07df-4d13-abbf-33093e757f87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:58.826173 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b40f0244-07df-4d13-abbf-33093e757f87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:58.827347 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b40f0244-07df-4d13-abbf-33093e757f87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1723 microversion: 2.20 time: 0.242242 Aug 08 02:38:58.827892 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 541/1070] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:58 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:38:59.410034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-e6378ca0-21b0-49fa-aa48-6e09da8bb22e req-d0e0f903-afe6-4f77-9573-c77edd788489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614b1928-9870-453b-8bf7-7b21f36ed2be", "name": "network-vif-deleted", "tag": "2d321e72-03cd-4396-9683-df053c6107d1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:38:59.422368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-e6378ca0-21b0-49fa-aa48-6e09da8bb22e req-d0e0f903-afe6-4f77-9573-c77edd788489 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:59.422846 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-e6378ca0-21b0-49fa-aa48-6e09da8bb22e req-d0e0f903-afe6-4f77-9573-c77edd788489 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:59.423912 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-e6378ca0-21b0-49fa-aa48-6e09da8bb22e req-d0e0f903-afe6-4f77-9573-c77edd788489 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:59.435220 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-e6378ca0-21b0-49fa-aa48-6e09da8bb22e req-d0e0f903-afe6-4f77-9573-c77edd788489 service nova] Creating event network-vif-deleted:2d321e72-03cd-4396-9683-df053c6107d1 for instance 614b1928-9870-453b-8bf7-7b21f36ed2be on hv-cinder-73306 Aug 08 02:38:59.440757 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-e6378ca0-21b0-49fa-aa48-6e09da8bb22e req-d0e0f903-afe6-4f77-9573-c77edd788489 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034733 Aug 08 02:38:59.441655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 530/1071] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:38:59.851458 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-512adb95-40af-4f04-9c1f-b1a9f46e1116 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:38:59.852064 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-512adb95-40af-4f04-9c1f-b1a9f46e1116 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:38:59.858403 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-512adb95-40af-4f04-9c1f-b1a9f46e1116 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:59.858877 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-512adb95-40af-4f04-9c1f-b1a9f46e1116 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:59.859299 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-512adb95-40af-4f04-9c1f-b1a9f46e1116 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:59.859970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-512adb95-40af-4f04-9c1f-b1a9f46e1116 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:38:59.860409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-512adb95-40af-4f04-9c1f-b1a9f46e1116 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:38:59.860824 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-512adb95-40af-4f04-9c1f-b1a9f46e1116 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:38:59.925570 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-512adb95-40af-4f04-9c1f-b1a9f46e1116 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:59.933491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-512adb95-40af-4f04-9c1f-b1a9f46e1116 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:59.935012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-512adb95-40af-4f04-9c1f-b1a9f46e1116 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:38:59.936141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-512adb95-40af-4f04-9c1f-b1a9f46e1116 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1365 microversion: 2.20 time: 0.088541 Aug 08 02:38:59.936687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 542/1072] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:38:59 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1365 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:39:00.960214 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-411e283b-b251-4501-9d53-3a76732e78ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:00.960913 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-411e283b-b251-4501-9d53-3a76732e78ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:00.967510 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-411e283b-b251-4501-9d53-3a76732e78ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:00.967990 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-411e283b-b251-4501-9d53-3a76732e78ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:00.968484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-411e283b-b251-4501-9d53-3a76732e78ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:00.969180 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-411e283b-b251-4501-9d53-3a76732e78ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:00.969630 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-411e283b-b251-4501-9d53-3a76732e78ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:00.970052 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-411e283b-b251-4501-9d53-3a76732e78ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:01.031217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-411e283b-b251-4501-9d53-3a76732e78ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:01.039065 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-411e283b-b251-4501-9d53-3a76732e78ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:01.040579 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-411e283b-b251-4501-9d53-3a76732e78ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:01.041704 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-411e283b-b251-4501-9d53-3a76732e78ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1365 microversion: 2.20 time: 0.085774 Aug 08 02:39:01.042273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 531/1073] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:00 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1365 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:39:02.235516 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:02.236123 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:02.242012 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:02.242519 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:02.242950 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:02.243632 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:02.244078 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:02.244494 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:02.275615 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:02.276089 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:02.276525 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:02.276966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.objects.instance [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lazy-loading 'fault' on Instance uuid 614b1928-9870-453b-8bf7-7b21f36ed2be {{(pid=117640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:39:02.320382 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:02.330291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:02.332252 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:02.333387 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1065f660-2eae-4544-8c30-4ad75dc817ac tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 200 len: 1370 microversion: 2.20 time: 0.268092 Aug 08 02:39:02.334608 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 543/1074] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:02 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 1370 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:39:03.356591 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-24692623-8015-4488-9a8d-fa5dfbb28dc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:03.357202 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-24692623-8015-4488-9a8d-fa5dfbb28dc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:03.364116 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24692623-8015-4488-9a8d-fa5dfbb28dc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:03.364610 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24692623-8015-4488-9a8d-fa5dfbb28dc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:03.365018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24692623-8015-4488-9a8d-fa5dfbb28dc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:03.365700 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24692623-8015-4488-9a8d-fa5dfbb28dc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:03.366178 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24692623-8015-4488-9a8d-fa5dfbb28dc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:03.366624 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24692623-8015-4488-9a8d-fa5dfbb28dc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:03.380264 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-24692623-8015-4488-9a8d-fa5dfbb28dc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] HTTP exception thrown: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-24692623-8015-4488-9a8d-fa5dfbb28dc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Request method failure captured: Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be HTTP/1.1 Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HYZSqCNJUwodo8x4ayVQzaNbr3dbFbbQhR5RnZ3Pkw73cLxha0rRoLbMBLakdXrkVrmz2ZQPKvxdYgR_CG1LiiyD-1FZAGi7LN2t1_HPQDmM0k4VthQL103eETgFqdFFUf6tsoSuH5vWaUysozCoJV6ENmJtYLM9td6KdqMzsr2VhU Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 6dcedd52439b47689047813e0566ba78 Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:39:03.381946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:39:03.383767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6dcedd52439b47689047813e0566ba78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dcedd52439b47689047813e0566ba78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6dcedd52439b47689047813e0566ba78", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dcedd52439b47689047813e0566ba78"}]}] Aug 08 02:39:03.383767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:39:03.383767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 6dcedd52439b47689047813e0566ba78 Aug 08 02:39:03.383767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:39:03.383767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeShelveTestJSON-1491463072-project Aug 08 02:39:03.383767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:39:03.383767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:39:03.383767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 5de4e28bfee14bae93c7f7a8f3f098fc Aug 08 02:39:03.383767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1491463072-project Aug 08 02:39:03.383767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:39:03.383767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:39:03.383767 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '614b1928-9870-453b-8bf7-7b21f36ed2be'} Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:39:03.384737 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:39:03.386018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:39:03.387244 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-24692623-8015-4488-9a8d-fa5dfbb28dc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Returning 404 to user: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:39:03.387244 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-24692623-8015-4488-9a8d-fa5dfbb28dc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 404 len: 111 microversion: 2.20 time: 0.030711 Aug 08 02:39:03.387244 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 532/1075] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:03 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:39:03.394885 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-023cdc6b-e91d-4496-a663-c2be4fc1ee36 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '.version_select at 0x7f3295400ee0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:03.420765 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-023cdc6b-e91d-4496-a663-c2be4fc1ee36 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-811407261" status: 204 len: 0 microversion: 2.20 time: 0.031929 Aug 08 02:39:03.421385 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 544/1076] 10.222.0.39 () {60 vars in 1259 bytes} [Mon Aug 8 02:39:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-811407261 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 02:39:04.276597 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7beffe4a-a73a-4e0f-8166-6fafbcb5a4ad tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Action: 'create', calling method: .version_select at 0x7f3295c7f3a0>, body: {"keypair": {"name": "tempest-keypair-1538353045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdHUAO4anyvkxbeKVp1ipEiR6LvRLjC+znRzeHWobTIiJv5ErjT0SEr75Qu/nr0vxuG4Qr0uEM0sBb3VB4a5e1VcjZYx82OKMgrjoht1/lQesXJFDtG7CNxsqRsbU8/FA=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:04.291733 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-7beffe4a-a73a-4e0f-8166-6fafbcb5a4ad tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Getting quotas for project 6dcedd52439b47689047813e0566ba78. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:39:04.295466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-7beffe4a-a73a-4e0f-8166-6fafbcb5a4ad tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Getting quotas for user 5de4e28bfee14bae93c7f7a8f3f098fc and project 6dcedd52439b47689047813e0566ba78. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:39:04.317676 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7beffe4a-a73a-4e0f-8166-6fafbcb5a4ad tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045027 Aug 08 02:39:04.318276 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 533/1077] 10.222.0.39 () {62 vars in 1200 bytes} [Mon Aug 8 02:39:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 02:39:05.571562 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-765900267", "imageRef": "7d4a0e57-60c3-4591-bd04-cdd08b25cd18", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b082417f-df0b-4b13-b79d-d6bf9807755d"}], "security_groups": [{"name": "tempest-securitygroup--349567238"}], "key_name": "tempest-keypair-1538353045", "user_data": "}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:05.678998 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.network.neutron [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] validate_networks() for [('b082417f-df0b-4b13-b79d-d6bf9807755d', None, None, None, None, None)] {{(pid=117640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:39:06.048242 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Flavor limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:39:06.048884 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Image limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:39:06.049911 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Flavor pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:39:06.050291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Image pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:39:06.050701 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:39:06.059361 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:06.059833 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:06.060256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:06.060970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:06.061412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:06.061827 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:06.080014 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Getting quotas for project 6dcedd52439b47689047813e0566ba78. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:39:06.083913 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Getting quotas for user 5de4e28bfee14bae93c7f7a8f3f098fc and project 6dcedd52439b47689047813e0566ba78. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:39:06.095169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Going to run 1 instances... {{(pid=117640) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:39:06.097708 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7d4a0e57-60c3-4591-bd04-cdd08b25cd18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:39:06.153065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d0138df1-bbd4-4fba-bd18-b80470334dd1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.586385 Aug 08 02:39:06.153699 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 545/1078] 10.222.0.39 () {62 vars in 1188 bytes} [Mon Aug 8 02:39:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 02:39:06.167945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cdaaaedc-946a-46fc-ab3e-d123a7cf538a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:06.168792 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cdaaaedc-946a-46fc-ab3e-d123a7cf538a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:06.225170 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cdaaaedc-946a-46fc-ab3e-d123a7cf538a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:06.232503 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cdaaaedc-946a-46fc-ab3e-d123a7cf538a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:06.234022 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cdaaaedc-946a-46fc-ab3e-d123a7cf538a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:06.235153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cdaaaedc-946a-46fc-ab3e-d123a7cf538a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1281 microversion: 2.20 time: 0.073240 Aug 08 02:39:06.235708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 534/1079] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:06 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:39:07.258494 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-6305b6a6-9f2a-4dab-9667-f6601aad7160 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:07.259114 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-6305b6a6-9f2a-4dab-9667-f6601aad7160 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:07.312415 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6305b6a6-9f2a-4dab-9667-f6601aad7160 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:07.320491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6305b6a6-9f2a-4dab-9667-f6601aad7160 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:07.322100 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-6305b6a6-9f2a-4dab-9667-f6601aad7160 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:07.323148 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-6305b6a6-9f2a-4dab-9667-f6601aad7160 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1281 microversion: 2.20 time: 0.068711 Aug 08 02:39:07.323921 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 546/1080] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:07 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:39:08.344899 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-828ccee4-d38f-42bd-aa4c-6aeb0364dd87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:08.345649 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-828ccee4-d38f-42bd-aa4c-6aeb0364dd87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:08.352786 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-828ccee4-d38f-42bd-aa4c-6aeb0364dd87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:08.353266 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-828ccee4-d38f-42bd-aa4c-6aeb0364dd87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:08.353700 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-828ccee4-d38f-42bd-aa4c-6aeb0364dd87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:08.354422 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-828ccee4-d38f-42bd-aa4c-6aeb0364dd87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:08.355049 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-828ccee4-d38f-42bd-aa4c-6aeb0364dd87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:08.355596 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-828ccee4-d38f-42bd-aa4c-6aeb0364dd87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:08.432635 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-828ccee4-d38f-42bd-aa4c-6aeb0364dd87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:08.441700 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-828ccee4-d38f-42bd-aa4c-6aeb0364dd87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:08.443273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-828ccee4-d38f-42bd-aa4c-6aeb0364dd87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:08.444375 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-828ccee4-d38f-42bd-aa4c-6aeb0364dd87 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1285 microversion: 2.20 time: 0.103391 Aug 08 02:39:08.445231 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 535/1081] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:08 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:39:09.467713 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9beb5c3b-6e61-4f61-8bdc-23701f559cf8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:09.468608 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9beb5c3b-6e61-4f61-8bdc-23701f559cf8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:09.475697 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9beb5c3b-6e61-4f61-8bdc-23701f559cf8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:09.476170 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9beb5c3b-6e61-4f61-8bdc-23701f559cf8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:09.476604 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9beb5c3b-6e61-4f61-8bdc-23701f559cf8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:09.477350 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9beb5c3b-6e61-4f61-8bdc-23701f559cf8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:09.477804 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9beb5c3b-6e61-4f61-8bdc-23701f559cf8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:09.478224 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9beb5c3b-6e61-4f61-8bdc-23701f559cf8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:09.553220 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-9beb5c3b-6e61-4f61-8bdc-23701f559cf8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:09.561379 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-9beb5c3b-6e61-4f61-8bdc-23701f559cf8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:09.562559 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-9beb5c3b-6e61-4f61-8bdc-23701f559cf8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:09.563651 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9beb5c3b-6e61-4f61-8bdc-23701f559cf8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1339 microversion: 2.20 time: 0.099900 Aug 08 02:39:09.564200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 547/1082] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:09 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:39:10.587607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ff88b17a-3cf4-424b-aa42-170434dea224 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:10.588334 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ff88b17a-3cf4-424b-aa42-170434dea224 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:10.594871 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff88b17a-3cf4-424b-aa42-170434dea224 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:10.595390 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff88b17a-3cf4-424b-aa42-170434dea224 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:10.595838 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff88b17a-3cf4-424b-aa42-170434dea224 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:10.596540 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff88b17a-3cf4-424b-aa42-170434dea224 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:10.596986 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff88b17a-3cf4-424b-aa42-170434dea224 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:10.597404 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff88b17a-3cf4-424b-aa42-170434dea224 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:10.608793 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-fa812bca-11b3-48cd-9627-5465bcd77e67 req-53a7b35c-1be7-4b63-97c4-289f83fbefc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19534a66-fc42-4903-9b95-0dc0cacc67c9", "tag": "cc4cfde3-9c47-4a92-a836-463545af627c"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:10.622645 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-fa812bca-11b3-48cd-9627-5465bcd77e67 req-53a7b35c-1be7-4b63-97c4-289f83fbefc1 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:10.623417 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-fa812bca-11b3-48cd-9627-5465bcd77e67 req-53a7b35c-1be7-4b63-97c4-289f83fbefc1 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:10.623985 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-fa812bca-11b3-48cd-9627-5465bcd77e67 req-53a7b35c-1be7-4b63-97c4-289f83fbefc1 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:10.638573 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-fa812bca-11b3-48cd-9627-5465bcd77e67 req-53a7b35c-1be7-4b63-97c4-289f83fbefc1 service nova] Creating event network-changed:cc4cfde3-9c47-4a92-a836-463545af627c for instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 on hv-cinder-73306 Aug 08 02:39:10.660543 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-fa812bca-11b3-48cd-9627-5465bcd77e67 req-53a7b35c-1be7-4b63-97c4-289f83fbefc1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052244 Aug 08 02:39:10.661159 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 548/1083] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:39:10.742756 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ff88b17a-3cf4-424b-aa42-170434dea224 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:10.750708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ff88b17a-3cf4-424b-aa42-170434dea224 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:10.752217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ff88b17a-3cf4-424b-aa42-170434dea224 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:10.753343 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ff88b17a-3cf4-424b-aa42-170434dea224 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1406 microversion: 2.20 time: 0.170127 Aug 08 02:39:10.753904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 536/1084] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:10 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:39:11.776459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8927d803-7b26-422f-ae7c-9beeb5ac317b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:11.777155 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8927d803-7b26-422f-ae7c-9beeb5ac317b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:11.783301 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8927d803-7b26-422f-ae7c-9beeb5ac317b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:11.783776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8927d803-7b26-422f-ae7c-9beeb5ac317b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:11.784210 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8927d803-7b26-422f-ae7c-9beeb5ac317b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:11.784886 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8927d803-7b26-422f-ae7c-9beeb5ac317b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:11.785338 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8927d803-7b26-422f-ae7c-9beeb5ac317b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:11.785760 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8927d803-7b26-422f-ae7c-9beeb5ac317b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:11.917174 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8927d803-7b26-422f-ae7c-9beeb5ac317b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:11.925495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8927d803-7b26-422f-ae7c-9beeb5ac317b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:11.927038 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8927d803-7b26-422f-ae7c-9beeb5ac317b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:11.928141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8927d803-7b26-422f-ae7c-9beeb5ac317b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1406 microversion: 2.20 time: 0.156360 Aug 08 02:39:11.928688 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 549/1085] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:11 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:39:12.951108 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1168aa4c-5814-429c-ae7b-87c4a05d916f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:12.951745 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1168aa4c-5814-429c-ae7b-87c4a05d916f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:12.958214 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1168aa4c-5814-429c-ae7b-87c4a05d916f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:12.958727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1168aa4c-5814-429c-ae7b-87c4a05d916f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:12.959158 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1168aa4c-5814-429c-ae7b-87c4a05d916f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:12.959839 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1168aa4c-5814-429c-ae7b-87c4a05d916f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:12.960286 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1168aa4c-5814-429c-ae7b-87c4a05d916f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:12.960710 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1168aa4c-5814-429c-ae7b-87c4a05d916f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:13.086727 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1168aa4c-5814-429c-ae7b-87c4a05d916f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:13.094510 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1168aa4c-5814-429c-ae7b-87c4a05d916f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:13.096045 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1168aa4c-5814-429c-ae7b-87c4a05d916f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:13.097139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1168aa4c-5814-429c-ae7b-87c4a05d916f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1406 microversion: 2.20 time: 0.150169 Aug 08 02:39:13.097688 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 537/1086] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:12 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:39:14.119278 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-212a0d27-290a-4902-a049-e6482ef56e89 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:14.119937 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-212a0d27-290a-4902-a049-e6482ef56e89 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:14.126548 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-212a0d27-290a-4902-a049-e6482ef56e89 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:14.127033 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-212a0d27-290a-4902-a049-e6482ef56e89 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:14.127464 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-212a0d27-290a-4902-a049-e6482ef56e89 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:14.128164 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-212a0d27-290a-4902-a049-e6482ef56e89 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:14.128614 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-212a0d27-290a-4902-a049-e6482ef56e89 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:14.129035 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-212a0d27-290a-4902-a049-e6482ef56e89 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:14.264033 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-212a0d27-290a-4902-a049-e6482ef56e89 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:14.272387 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-212a0d27-290a-4902-a049-e6482ef56e89 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:14.273869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-212a0d27-290a-4902-a049-e6482ef56e89 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:14.274990 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-212a0d27-290a-4902-a049-e6482ef56e89 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1406 microversion: 2.20 time: 0.159898 Aug 08 02:39:14.275534 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 550/1087] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:14 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:39:15.297536 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-817ad222-89b2-41df-8b26-2842ffc5043e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:15.298139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-817ad222-89b2-41df-8b26-2842ffc5043e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:15.305191 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-817ad222-89b2-41df-8b26-2842ffc5043e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:15.305663 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-817ad222-89b2-41df-8b26-2842ffc5043e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:15.306087 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-817ad222-89b2-41df-8b26-2842ffc5043e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:15.306798 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-817ad222-89b2-41df-8b26-2842ffc5043e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:15.307243 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-817ad222-89b2-41df-8b26-2842ffc5043e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:15.307657 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-817ad222-89b2-41df-8b26-2842ffc5043e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:15.439341 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-817ad222-89b2-41df-8b26-2842ffc5043e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:15.447945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-817ad222-89b2-41df-8b26-2842ffc5043e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:15.449483 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-817ad222-89b2-41df-8b26-2842ffc5043e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:15.450620 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-817ad222-89b2-41df-8b26-2842ffc5043e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1406 microversion: 2.20 time: 0.156960 Aug 08 02:39:15.451182 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 538/1088] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:15 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:39:16.087217 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-fc7607b7-5139-4ce3-a883-dad9367d8bd5 req-6e13f4f6-6499-43cf-926b-fd58ca057cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19534a66-fc42-4903-9b95-0dc0cacc67c9", "name": "network-vif-plugged", "status": "completed", "tag": "cc4cfde3-9c47-4a92-a836-463545af627c"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:16.092733 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:16.099765 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-fc7607b7-5139-4ce3-a883-dad9367d8bd5 req-6e13f4f6-6499-43cf-926b-fd58ca057cf0 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:16.100447 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-fc7607b7-5139-4ce3-a883-dad9367d8bd5 req-6e13f4f6-6499-43cf-926b-fd58ca057cf0 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:16.100886 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-fc7607b7-5139-4ce3-a883-dad9367d8bd5 req-6e13f4f6-6499-43cf-926b-fd58ca057cf0 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:16.112148 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-fc7607b7-5139-4ce3-a883-dad9367d8bd5 req-6e13f4f6-6499-43cf-926b-fd58ca057cf0 service nova] Creating event network-vif-plugged:cc4cfde3-9c47-4a92-a836-463545af627c for instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 on hv-cinder-73306 Aug 08 02:39:16.117203 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-fc7607b7-5139-4ce3-a883-dad9367d8bd5 req-6e13f4f6-6499-43cf-926b-fd58ca057cf0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033942 Aug 08 02:39:16.117792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 551/1089] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:39:16.473010 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e78d1b17-d83c-4e8d-ac38-e1da49b9fbba tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:16.473642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e78d1b17-d83c-4e8d-ac38-e1da49b9fbba tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:16.475582 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:16.481278 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e78d1b17-d83c-4e8d-ac38-e1da49b9fbba tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:16.481748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e78d1b17-d83c-4e8d-ac38-e1da49b9fbba tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:16.482175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e78d1b17-d83c-4e8d-ac38-e1da49b9fbba tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:16.482875 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e78d1b17-d83c-4e8d-ac38-e1da49b9fbba tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:16.483317 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e78d1b17-d83c-4e8d-ac38-e1da49b9fbba tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:16.483747 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e78d1b17-d83c-4e8d-ac38-e1da49b9fbba tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:16.611436 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e78d1b17-d83c-4e8d-ac38-e1da49b9fbba tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:16.619728 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e78d1b17-d83c-4e8d-ac38-e1da49b9fbba tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:16.621221 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e78d1b17-d83c-4e8d-ac38-e1da49b9fbba tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:16.622337 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e78d1b17-d83c-4e8d-ac38-e1da49b9fbba tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1406 microversion: 2.20 time: 0.153253 Aug 08 02:39:16.622899 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 539/1090] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:16 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:39:17.646589 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3a71c201-35aa-469f-b2b6-576d7def4352 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:17.647216 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3a71c201-35aa-469f-b2b6-576d7def4352 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:17.649556 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=8 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:39:17.655285 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3a71c201-35aa-469f-b2b6-576d7def4352 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:17.655755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3a71c201-35aa-469f-b2b6-576d7def4352 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:17.656184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3a71c201-35aa-469f-b2b6-576d7def4352 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:17.656854 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3a71c201-35aa-469f-b2b6-576d7def4352 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:17.657321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3a71c201-35aa-469f-b2b6-576d7def4352 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:17.657733 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3a71c201-35aa-469f-b2b6-576d7def4352 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:17.788015 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3a71c201-35aa-469f-b2b6-576d7def4352 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:17.795853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3a71c201-35aa-469f-b2b6-576d7def4352 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:17.797346 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3a71c201-35aa-469f-b2b6-576d7def4352 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:17.798465 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3a71c201-35aa-469f-b2b6-576d7def4352 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1406 microversion: 2.20 time: 0.156897 Aug 08 02:39:17.799508 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 552/1091] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:17 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:39:18.821022 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-078e0f40-ae6b-4550-b1de-80cc8e8fde2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:18.821668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-078e0f40-ae6b-4550-b1de-80cc8e8fde2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:18.828140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-078e0f40-ae6b-4550-b1de-80cc8e8fde2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:18.828623 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-078e0f40-ae6b-4550-b1de-80cc8e8fde2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:18.829058 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-078e0f40-ae6b-4550-b1de-80cc8e8fde2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:18.829750 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-078e0f40-ae6b-4550-b1de-80cc8e8fde2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:18.830709 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-078e0f40-ae6b-4550-b1de-80cc8e8fde2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:18.831139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-078e0f40-ae6b-4550-b1de-80cc8e8fde2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:18.958609 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-078e0f40-ae6b-4550-b1de-80cc8e8fde2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:18.966440 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-078e0f40-ae6b-4550-b1de-80cc8e8fde2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:18.967958 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-078e0f40-ae6b-4550-b1de-80cc8e8fde2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:39:18.969100 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-078e0f40-ae6b-4550-b1de-80cc8e8fde2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1598 microversion: 2.20 time: 0.152054 Aug 08 02:39:18.969662 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 540/1092] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:39:18 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:39:18.990775 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-471c187d-d84f-4eba-ba3c-e0160df46870 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:39:18.991271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-471c187d-d84f-4eba-ba3c-e0160df46870 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:39:18.997494 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-471c187d-d84f-4eba-ba3c-e0160df46870 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:18.997966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-471c187d-d84f-4eba-ba3c-e0160df46870 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:18.998430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-471c187d-d84f-4eba-ba3c-e0160df46870 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:18.999141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-471c187d-d84f-4eba-ba3c-e0160df46870 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:18.999587 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-471c187d-d84f-4eba-ba3c-e0160df46870 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:19.000035 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-471c187d-d84f-4eba-ba3c-e0160df46870 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:19.076793 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-471c187d-d84f-4eba-ba3c-e0160df46870 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089799 Aug 08 02:39:19.077412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 553/1093] 10.222.0.39 () {60 vars in 1316 bytes} [Mon Aug 8 02:39:18 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:39:20.243916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-9c69af30-10e2-485f-b192-ba8d7275d96e req-5ea17322-90d6-4a31-8493-c70406f69883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19534a66-fc42-4903-9b95-0dc0cacc67c9", "tag": "cc4cfde3-9c47-4a92-a836-463545af627c"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:39:20.253889 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9c69af30-10e2-485f-b192-ba8d7275d96e req-5ea17322-90d6-4a31-8493-c70406f69883 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:39:20.254390 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9c69af30-10e2-485f-b192-ba8d7275d96e req-5ea17322-90d6-4a31-8493-c70406f69883 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:39:20.254819 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9c69af30-10e2-485f-b192-ba8d7275d96e req-5ea17322-90d6-4a31-8493-c70406f69883 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:39:20.266753 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-9c69af30-10e2-485f-b192-ba8d7275d96e req-5ea17322-90d6-4a31-8493-c70406f69883 service nova] Creating event network-changed:cc4cfde3-9c47-4a92-a836-463545af627c for instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 on hv-cinder-73306 Aug 08 02:39:20.272215 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-9c69af30-10e2-485f-b192-ba8d7275d96e req-5ea17322-90d6-4a31-8493-c70406f69883 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032114 Aug 08 02:39:20.273033 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 541/1094] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:40:38.455178 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:38.455921 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=78 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:38.461761 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-30408aff-a255-40c6-b276-73fed171e20e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:38.462274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-30408aff-a255-40c6-b276-73fed171e20e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:38.470097 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-30408aff-a255-40c6-b276-73fed171e20e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:38.470611 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-30408aff-a255-40c6-b276-73fed171e20e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:38.471045 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-30408aff-a255-40c6-b276-73fed171e20e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:38.472033 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-30408aff-a255-40c6-b276-73fed171e20e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:38.472572 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-30408aff-a255-40c6-b276-73fed171e20e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:38.472991 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-30408aff-a255-40c6-b276-73fed171e20e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:38.497377 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-30408aff-a255-40c6-b276-73fed171e20e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/ips" status: 200 len: 151 microversion: 2.20 time: 0.044107 Aug 08 02:40:38.497935 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 554/1095] 10.222.0.39 () {60 vars in 1289 bytes} [Mon Aug 8 02:40:38 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:40:40.739510 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:40.740167 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:40:40.745368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-524aeec7-e6be-4fa7-9a24-7bf84cbb75e6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:40.746008 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-524aeec7-e6be-4fa7-9a24-7bf84cbb75e6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:40.754291 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-524aeec7-e6be-4fa7-9a24-7bf84cbb75e6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:40.754903 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-524aeec7-e6be-4fa7-9a24-7bf84cbb75e6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:40.755335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-524aeec7-e6be-4fa7-9a24-7bf84cbb75e6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:40.756015 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-524aeec7-e6be-4fa7-9a24-7bf84cbb75e6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:40.756464 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-524aeec7-e6be-4fa7-9a24-7bf84cbb75e6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:40.756881 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-524aeec7-e6be-4fa7-9a24-7bf84cbb75e6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:40.780739 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-524aeec7-e6be-4fa7-9a24-7bf84cbb75e6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lazy-loading 'flavor' on Instance uuid 19534a66-fc42-4903-9b95-0dc0cacc67c9 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:40:41.114929 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-524aeec7-e6be-4fa7-9a24-7bf84cbb75e6 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "POST /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/action" status: 202 len: 0 microversion: 2.20 time: 0.378246 Aug 08 02:40:41.115663 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 542/1096] 10.222.0.39 () {62 vars in 1319 bytes} [Mon Aug 8 02:40:40 2022] POST /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:40:41.123673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fbfc89cf-77d6-4756-8fb4-ef4761e419a0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:41.124281 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-fbfc89cf-77d6-4756-8fb4-ef4761e419a0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:41.130682 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fbfc89cf-77d6-4756-8fb4-ef4761e419a0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:41.131158 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fbfc89cf-77d6-4756-8fb4-ef4761e419a0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:41.131588 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fbfc89cf-77d6-4756-8fb4-ef4761e419a0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:41.132278 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fbfc89cf-77d6-4756-8fb4-ef4761e419a0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:41.132724 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fbfc89cf-77d6-4756-8fb4-ef4761e419a0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:41.133149 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fbfc89cf-77d6-4756-8fb4-ef4761e419a0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:41.366021 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-fbfc89cf-77d6-4756-8fb4-ef4761e419a0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:41.373820 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-fbfc89cf-77d6-4756-8fb4-ef4761e419a0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:41.375358 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-fbfc89cf-77d6-4756-8fb4-ef4761e419a0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:41.376525 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fbfc89cf-77d6-4756-8fb4-ef4761e419a0 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.256763 Aug 08 02:40:41.377057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 555/1097] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:41 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:42.400880 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6780baed-99f4-48da-bd19-f1ea15117032 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:42.401607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6780baed-99f4-48da-bd19-f1ea15117032 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:42.411080 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6780baed-99f4-48da-bd19-f1ea15117032 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:42.411562 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6780baed-99f4-48da-bd19-f1ea15117032 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:42.411999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6780baed-99f4-48da-bd19-f1ea15117032 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:42.412688 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6780baed-99f4-48da-bd19-f1ea15117032 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:42.413140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6780baed-99f4-48da-bd19-f1ea15117032 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:42.413565 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6780baed-99f4-48da-bd19-f1ea15117032 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:42.547384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6780baed-99f4-48da-bd19-f1ea15117032 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:42.555267 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6780baed-99f4-48da-bd19-f1ea15117032 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:42.556810 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6780baed-99f4-48da-bd19-f1ea15117032 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:42.557965 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6780baed-99f4-48da-bd19-f1ea15117032 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.161931 Aug 08 02:40:42.558560 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 543/1098] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:42 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:43.515562 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:40:43.516113 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Mon Aug 8 02:40:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:40:43.580778 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-65c66974-45b5-4e1a-9b57-28a758d6e9a8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:43.581390 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-65c66974-45b5-4e1a-9b57-28a758d6e9a8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:43.587825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-65c66974-45b5-4e1a-9b57-28a758d6e9a8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:43.588430 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-65c66974-45b5-4e1a-9b57-28a758d6e9a8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:43.588849 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-65c66974-45b5-4e1a-9b57-28a758d6e9a8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:43.589758 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-65c66974-45b5-4e1a-9b57-28a758d6e9a8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:43.590274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-65c66974-45b5-4e1a-9b57-28a758d6e9a8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:43.590708 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-65c66974-45b5-4e1a-9b57-28a758d6e9a8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:43.725384 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-65c66974-45b5-4e1a-9b57-28a758d6e9a8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:43.733487 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-65c66974-45b5-4e1a-9b57-28a758d6e9a8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:43.735092 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-65c66974-45b5-4e1a-9b57-28a758d6e9a8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:43.736212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-65c66974-45b5-4e1a-9b57-28a758d6e9a8 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.159323 Aug 08 02:40:43.736770 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 556/1099] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:43 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:44.760716 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a663999a-c0ca-49b2-a937-589162afe367 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:44.761332 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a663999a-c0ca-49b2-a937-589162afe367 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:44.767411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a663999a-c0ca-49b2-a937-589162afe367 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:44.767886 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a663999a-c0ca-49b2-a937-589162afe367 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:44.768318 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a663999a-c0ca-49b2-a937-589162afe367 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:44.769038 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a663999a-c0ca-49b2-a937-589162afe367 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:44.769484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a663999a-c0ca-49b2-a937-589162afe367 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:44.769908 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a663999a-c0ca-49b2-a937-589162afe367 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:44.898106 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a663999a-c0ca-49b2-a937-589162afe367 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:44.906015 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a663999a-c0ca-49b2-a937-589162afe367 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:44.907697 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a663999a-c0ca-49b2-a937-589162afe367 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:44.908851 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a663999a-c0ca-49b2-a937-589162afe367 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.152201 Aug 08 02:40:44.909402 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 544/1100] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:44 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:45.932454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-007d7187-95fe-402f-87e0-a51b53939146 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:45.933063 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-007d7187-95fe-402f-87e0-a51b53939146 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:45.939473 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-007d7187-95fe-402f-87e0-a51b53939146 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:45.939943 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-007d7187-95fe-402f-87e0-a51b53939146 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:45.940624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-007d7187-95fe-402f-87e0-a51b53939146 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:45.941331 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-007d7187-95fe-402f-87e0-a51b53939146 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:45.941777 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-007d7187-95fe-402f-87e0-a51b53939146 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:45.942199 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-007d7187-95fe-402f-87e0-a51b53939146 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:46.069408 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-007d7187-95fe-402f-87e0-a51b53939146 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:46.077385 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-007d7187-95fe-402f-87e0-a51b53939146 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:46.078915 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-007d7187-95fe-402f-87e0-a51b53939146 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:46.080054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-007d7187-95fe-402f-87e0-a51b53939146 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.151605 Aug 08 02:40:46.080612 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 557/1101] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:45 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:47.102747 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ee0c7a95-6844-4295-86f6-53cb9284f5ca tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:47.103459 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ee0c7a95-6844-4295-86f6-53cb9284f5ca tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:47.109788 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ee0c7a95-6844-4295-86f6-53cb9284f5ca tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:47.110299 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ee0c7a95-6844-4295-86f6-53cb9284f5ca tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:47.110734 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ee0c7a95-6844-4295-86f6-53cb9284f5ca tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:47.111416 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ee0c7a95-6844-4295-86f6-53cb9284f5ca tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:47.111865 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ee0c7a95-6844-4295-86f6-53cb9284f5ca tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:47.112285 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ee0c7a95-6844-4295-86f6-53cb9284f5ca tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:47.243619 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ee0c7a95-6844-4295-86f6-53cb9284f5ca tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:47.251484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ee0c7a95-6844-4295-86f6-53cb9284f5ca tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:47.252991 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ee0c7a95-6844-4295-86f6-53cb9284f5ca tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:47.254777 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ee0c7a95-6844-4295-86f6-53cb9284f5ca tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.155982 Aug 08 02:40:47.255329 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 545/1102] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:47 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:48.277482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-27157ba5-9b26-407d-85bb-22f54fc7b3ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:48.278079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-27157ba5-9b26-407d-85bb-22f54fc7b3ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:48.284433 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-27157ba5-9b26-407d-85bb-22f54fc7b3ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:48.284909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-27157ba5-9b26-407d-85bb-22f54fc7b3ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:48.285334 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-27157ba5-9b26-407d-85bb-22f54fc7b3ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:48.286003 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-27157ba5-9b26-407d-85bb-22f54fc7b3ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:48.286475 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-27157ba5-9b26-407d-85bb-22f54fc7b3ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:48.286896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-27157ba5-9b26-407d-85bb-22f54fc7b3ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:48.415127 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-27157ba5-9b26-407d-85bb-22f54fc7b3ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:48.423011 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-27157ba5-9b26-407d-85bb-22f54fc7b3ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:48.424490 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-27157ba5-9b26-407d-85bb-22f54fc7b3ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:48.426122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-27157ba5-9b26-407d-85bb-22f54fc7b3ae tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.152598 Aug 08 02:40:48.426704 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 558/1103] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:48 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:49.449516 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6bf8f4cd-e909-426c-88cf-0231a0787ea1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:49.450125 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6bf8f4cd-e909-426c-88cf-0231a0787ea1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:49.457006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bf8f4cd-e909-426c-88cf-0231a0787ea1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:49.457478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bf8f4cd-e909-426c-88cf-0231a0787ea1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:49.457904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bf8f4cd-e909-426c-88cf-0231a0787ea1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:49.458609 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bf8f4cd-e909-426c-88cf-0231a0787ea1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:49.459056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bf8f4cd-e909-426c-88cf-0231a0787ea1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:49.459469 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6bf8f4cd-e909-426c-88cf-0231a0787ea1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:49.589156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6bf8f4cd-e909-426c-88cf-0231a0787ea1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:49.597076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6bf8f4cd-e909-426c-88cf-0231a0787ea1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:49.598600 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6bf8f4cd-e909-426c-88cf-0231a0787ea1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:49.599739 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6bf8f4cd-e909-426c-88cf-0231a0787ea1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.154378 Aug 08 02:40:49.600288 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 546/1104] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:49 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:50.622641 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d2f02f35-d5c5-4c4d-b27a-97d0d04e6c4b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:50.623244 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d2f02f35-d5c5-4c4d-b27a-97d0d04e6c4b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:50.629697 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2f02f35-d5c5-4c4d-b27a-97d0d04e6c4b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:50.630168 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2f02f35-d5c5-4c4d-b27a-97d0d04e6c4b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:50.630623 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2f02f35-d5c5-4c4d-b27a-97d0d04e6c4b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:50.631330 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2f02f35-d5c5-4c4d-b27a-97d0d04e6c4b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:50.631775 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2f02f35-d5c5-4c4d-b27a-97d0d04e6c4b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:50.632191 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d2f02f35-d5c5-4c4d-b27a-97d0d04e6c4b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:50.758552 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d2f02f35-d5c5-4c4d-b27a-97d0d04e6c4b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:50.766535 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d2f02f35-d5c5-4c4d-b27a-97d0d04e6c4b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:50.768034 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d2f02f35-d5c5-4c4d-b27a-97d0d04e6c4b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:50.769693 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d2f02f35-d5c5-4c4d-b27a-97d0d04e6c4b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.150922 Aug 08 02:40:50.770264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 559/1105] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:50 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:51.792909 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eb93fdd9-af3a-4bcc-83ae-709e1f08b084 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:51.793524 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eb93fdd9-af3a-4bcc-83ae-709e1f08b084 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:51.800617 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb93fdd9-af3a-4bcc-83ae-709e1f08b084 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:51.801100 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb93fdd9-af3a-4bcc-83ae-709e1f08b084 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:51.801532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb93fdd9-af3a-4bcc-83ae-709e1f08b084 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:51.802224 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb93fdd9-af3a-4bcc-83ae-709e1f08b084 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:51.802733 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb93fdd9-af3a-4bcc-83ae-709e1f08b084 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:51.803156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb93fdd9-af3a-4bcc-83ae-709e1f08b084 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:51.929489 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eb93fdd9-af3a-4bcc-83ae-709e1f08b084 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:51.937359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eb93fdd9-af3a-4bcc-83ae-709e1f08b084 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:51.938888 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eb93fdd9-af3a-4bcc-83ae-709e1f08b084 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:51.940025 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eb93fdd9-af3a-4bcc-83ae-709e1f08b084 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.151041 Aug 08 02:40:51.940841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 547/1106] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:51 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:52.962983 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b4e5def4-d369-4f6b-812a-00204925f363 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:52.963592 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b4e5def4-d369-4f6b-812a-00204925f363 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:52.970106 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b4e5def4-d369-4f6b-812a-00204925f363 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:52.970619 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b4e5def4-d369-4f6b-812a-00204925f363 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:52.971052 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b4e5def4-d369-4f6b-812a-00204925f363 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:52.971732 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b4e5def4-d369-4f6b-812a-00204925f363 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:52.972182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b4e5def4-d369-4f6b-812a-00204925f363 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:52.972600 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b4e5def4-d369-4f6b-812a-00204925f363 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:53.100711 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b4e5def4-d369-4f6b-812a-00204925f363 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:53.108521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b4e5def4-d369-4f6b-812a-00204925f363 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:53.110003 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b4e5def4-d369-4f6b-812a-00204925f363 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:53.111166 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b4e5def4-d369-4f6b-812a-00204925f363 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1743 microversion: 2.20 time: 0.152145 Aug 08 02:40:53.111721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 560/1107] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:52 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:54.137974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-de759db4-da43-4347-b0ad-b2fcf9be201d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:54.139126 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-de759db4-da43-4347-b0ad-b2fcf9be201d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:54.147647 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-de759db4-da43-4347-b0ad-b2fcf9be201d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:54.148331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-de759db4-da43-4347-b0ad-b2fcf9be201d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:54.148960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-de759db4-da43-4347-b0ad-b2fcf9be201d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:54.149932 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-de759db4-da43-4347-b0ad-b2fcf9be201d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:54.150413 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-de759db4-da43-4347-b0ad-b2fcf9be201d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:54.150834 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-de759db4-da43-4347-b0ad-b2fcf9be201d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:54.295576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-de759db4-da43-4347-b0ad-b2fcf9be201d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:54.303974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-de759db4-da43-4347-b0ad-b2fcf9be201d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:54.305479 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-de759db4-da43-4347-b0ad-b2fcf9be201d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:54.306656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-de759db4-da43-4347-b0ad-b2fcf9be201d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1743 microversion: 2.20 time: 0.175040 Aug 08 02:40:54.307219 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 548/1108] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:54 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:55.329264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4d385dad-4861-4bde-81dc-944b3d81f98d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:55.329902 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4d385dad-4861-4bde-81dc-944b3d81f98d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:55.337018 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d385dad-4861-4bde-81dc-944b3d81f98d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:55.337497 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d385dad-4861-4bde-81dc-944b3d81f98d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:55.337925 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d385dad-4861-4bde-81dc-944b3d81f98d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:55.338640 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d385dad-4861-4bde-81dc-944b3d81f98d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:55.339091 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d385dad-4861-4bde-81dc-944b3d81f98d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:55.339510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4d385dad-4861-4bde-81dc-944b3d81f98d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:55.469312 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4d385dad-4861-4bde-81dc-944b3d81f98d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:55.477712 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4d385dad-4861-4bde-81dc-944b3d81f98d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:55.479226 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4d385dad-4861-4bde-81dc-944b3d81f98d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:55.480366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4d385dad-4861-4bde-81dc-944b3d81f98d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1743 microversion: 2.20 time: 0.155027 Aug 08 02:40:55.480914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 561/1109] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:55 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:56.448105 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-edf3a7d8-d6e6-40e4-b52b-081bc2bf6035 req-b3d0617f-2569-4260-acc7-ad88934ad6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19534a66-fc42-4903-9b95-0dc0cacc67c9", "name": "network-vif-plugged", "status": "completed", "tag": "cc4cfde3-9c47-4a92-a836-463545af627c"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:40:56.459329 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-edf3a7d8-d6e6-40e4-b52b-081bc2bf6035 req-b3d0617f-2569-4260-acc7-ad88934ad6e8 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:56.459804 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-edf3a7d8-d6e6-40e4-b52b-081bc2bf6035 req-b3d0617f-2569-4260-acc7-ad88934ad6e8 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:56.460228 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-edf3a7d8-d6e6-40e4-b52b-081bc2bf6035 req-b3d0617f-2569-4260-acc7-ad88934ad6e8 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:56.474035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-edf3a7d8-d6e6-40e4-b52b-081bc2bf6035 req-b3d0617f-2569-4260-acc7-ad88934ad6e8 service nova] Creating event network-vif-plugged:cc4cfde3-9c47-4a92-a836-463545af627c for instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 on hv-cinder-73306 Aug 08 02:40:56.479263 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-edf3a7d8-d6e6-40e4-b52b-081bc2bf6035 req-b3d0617f-2569-4260-acc7-ad88934ad6e8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035064 Aug 08 02:40:56.479886 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 549/1110] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:40:56.503711 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-deff834d-fc3e-46b4-94af-5442fc58fff2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:56.504401 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-deff834d-fc3e-46b4-94af-5442fc58fff2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:56.510722 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-deff834d-fc3e-46b4-94af-5442fc58fff2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:56.511222 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-deff834d-fc3e-46b4-94af-5442fc58fff2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:56.511649 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-deff834d-fc3e-46b4-94af-5442fc58fff2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:56.512336 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-deff834d-fc3e-46b4-94af-5442fc58fff2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:56.512779 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-deff834d-fc3e-46b4-94af-5442fc58fff2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:56.513197 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-deff834d-fc3e-46b4-94af-5442fc58fff2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:56.640480 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-deff834d-fc3e-46b4-94af-5442fc58fff2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:56.648894 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-deff834d-fc3e-46b4-94af-5442fc58fff2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:56.650434 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-deff834d-fc3e-46b4-94af-5442fc58fff2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:56.651584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-deff834d-fc3e-46b4-94af-5442fc58fff2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1743 microversion: 2.20 time: 0.152253 Aug 08 02:40:56.652147 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 562/1111] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:56 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:57.675517 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f2b336a8-e060-4b1f-aa99-965cb68e6ebe tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:57.676213 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f2b336a8-e060-4b1f-aa99-965cb68e6ebe tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:57.682381 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2b336a8-e060-4b1f-aa99-965cb68e6ebe tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:57.682860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2b336a8-e060-4b1f-aa99-965cb68e6ebe tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:57.683288 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2b336a8-e060-4b1f-aa99-965cb68e6ebe tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:57.683967 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2b336a8-e060-4b1f-aa99-965cb68e6ebe tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:57.684415 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2b336a8-e060-4b1f-aa99-965cb68e6ebe tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:57.684835 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f2b336a8-e060-4b1f-aa99-965cb68e6ebe tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:57.812310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f2b336a8-e060-4b1f-aa99-965cb68e6ebe tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:57.820939 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f2b336a8-e060-4b1f-aa99-965cb68e6ebe tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:57.822485 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f2b336a8-e060-4b1f-aa99-965cb68e6ebe tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:57.823643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f2b336a8-e060-4b1f-aa99-965cb68e6ebe tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1743 microversion: 2.20 time: 0.152877 Aug 08 02:40:57.824208 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 550/1112] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:57 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:40:58.849949 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-13d058cf-8aa4-4e23-a9fe-50265b17177a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:40:58.850591 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-13d058cf-8aa4-4e23-a9fe-50265b17177a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:40:58.857163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13d058cf-8aa4-4e23-a9fe-50265b17177a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:58.857633 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13d058cf-8aa4-4e23-a9fe-50265b17177a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:58.858128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13d058cf-8aa4-4e23-a9fe-50265b17177a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:58.858882 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13d058cf-8aa4-4e23-a9fe-50265b17177a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:40:58.859327 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13d058cf-8aa4-4e23-a9fe-50265b17177a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:40:58.859821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-13d058cf-8aa4-4e23-a9fe-50265b17177a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:40:58.997841 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-13d058cf-8aa4-4e23-a9fe-50265b17177a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:59.005909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-13d058cf-8aa4-4e23-a9fe-50265b17177a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:59.007433 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-13d058cf-8aa4-4e23-a9fe-50265b17177a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:40:59.008572 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-13d058cf-8aa4-4e23-a9fe-50265b17177a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1738 microversion: 2.20 time: 0.162960 Aug 08 02:40:59.009244 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 563/1113] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:40:58 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:00.033397 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-209a79e2-02c1-4c24-869f-f2fe80951ab2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:00.035437 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-209a79e2-02c1-4c24-869f-f2fe80951ab2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:00.042457 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-209a79e2-02c1-4c24-869f-f2fe80951ab2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:00.043012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-209a79e2-02c1-4c24-869f-f2fe80951ab2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:00.043684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-209a79e2-02c1-4c24-869f-f2fe80951ab2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:00.044685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-209a79e2-02c1-4c24-869f-f2fe80951ab2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:00.045210 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-209a79e2-02c1-4c24-869f-f2fe80951ab2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:00.045699 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-209a79e2-02c1-4c24-869f-f2fe80951ab2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:00.183660 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-209a79e2-02c1-4c24-869f-f2fe80951ab2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:00.192643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-209a79e2-02c1-4c24-869f-f2fe80951ab2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:00.194135 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-209a79e2-02c1-4c24-869f-f2fe80951ab2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:00.195429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-209a79e2-02c1-4c24-869f-f2fe80951ab2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1738 microversion: 2.20 time: 0.166444 Aug 08 02:41:00.196209 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 551/1114] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:00 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:01.218776 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-84280f4b-5010-4c9f-9bc7-5576f494cb4c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:01.219684 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-84280f4b-5010-4c9f-9bc7-5576f494cb4c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:01.226441 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-84280f4b-5010-4c9f-9bc7-5576f494cb4c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:01.227163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-84280f4b-5010-4c9f-9bc7-5576f494cb4c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:01.227814 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-84280f4b-5010-4c9f-9bc7-5576f494cb4c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:01.228747 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-84280f4b-5010-4c9f-9bc7-5576f494cb4c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:01.229420 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-84280f4b-5010-4c9f-9bc7-5576f494cb4c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:01.230169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-84280f4b-5010-4c9f-9bc7-5576f494cb4c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:01.371512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-84280f4b-5010-4c9f-9bc7-5576f494cb4c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:01.381716 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-84280f4b-5010-4c9f-9bc7-5576f494cb4c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:01.384209 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-84280f4b-5010-4c9f-9bc7-5576f494cb4c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:01.386022 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-84280f4b-5010-4c9f-9bc7-5576f494cb4c tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1738 microversion: 2.20 time: 0.171210 Aug 08 02:41:01.394322 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 564/1115] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:01 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:02.411252 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d06ef4f0-096d-4398-80be-6ca413dd61bb tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:02.412621 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d06ef4f0-096d-4398-80be-6ca413dd61bb tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:02.419936 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d06ef4f0-096d-4398-80be-6ca413dd61bb tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:02.420685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d06ef4f0-096d-4398-80be-6ca413dd61bb tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:02.421119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d06ef4f0-096d-4398-80be-6ca413dd61bb tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:02.421823 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d06ef4f0-096d-4398-80be-6ca413dd61bb tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:02.422443 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d06ef4f0-096d-4398-80be-6ca413dd61bb tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:02.423212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d06ef4f0-096d-4398-80be-6ca413dd61bb tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:02.576998 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d06ef4f0-096d-4398-80be-6ca413dd61bb tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:02.586534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d06ef4f0-096d-4398-80be-6ca413dd61bb tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:02.589295 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d06ef4f0-096d-4398-80be-6ca413dd61bb tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:02.590544 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d06ef4f0-096d-4398-80be-6ca413dd61bb tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1738 microversion: 2.20 time: 0.183189 Aug 08 02:41:02.591484 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 552/1116] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:02 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:03.613228 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b04405bf-f815-4e70-91fb-cc8962877300 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:03.613822 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b04405bf-f815-4e70-91fb-cc8962877300 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:03.620355 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b04405bf-f815-4e70-91fb-cc8962877300 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:03.620644 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b04405bf-f815-4e70-91fb-cc8962877300 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:03.621069 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b04405bf-f815-4e70-91fb-cc8962877300 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:03.621757 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b04405bf-f815-4e70-91fb-cc8962877300 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:03.622210 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b04405bf-f815-4e70-91fb-cc8962877300 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:03.622644 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b04405bf-f815-4e70-91fb-cc8962877300 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:03.777821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b04405bf-f815-4e70-91fb-cc8962877300 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:03.786634 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b04405bf-f815-4e70-91fb-cc8962877300 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:03.788160 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b04405bf-f815-4e70-91fb-cc8962877300 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:03.789342 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b04405bf-f815-4e70-91fb-cc8962877300 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1738 microversion: 2.20 time: 0.180033 Aug 08 02:41:03.790070 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 565/1117] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:03 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:04.812272 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b1347492-350d-45d2-8f79-7e532cfe8d69 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:04.813517 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b1347492-350d-45d2-8f79-7e532cfe8d69 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:04.820958 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1347492-350d-45d2-8f79-7e532cfe8d69 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:04.821445 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1347492-350d-45d2-8f79-7e532cfe8d69 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:04.821878 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1347492-350d-45d2-8f79-7e532cfe8d69 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:04.822809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1347492-350d-45d2-8f79-7e532cfe8d69 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:04.823439 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1347492-350d-45d2-8f79-7e532cfe8d69 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:04.824026 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b1347492-350d-45d2-8f79-7e532cfe8d69 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:04.967952 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b1347492-350d-45d2-8f79-7e532cfe8d69 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:04.979321 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b1347492-350d-45d2-8f79-7e532cfe8d69 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:04.980857 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b1347492-350d-45d2-8f79-7e532cfe8d69 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:04.982016 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b1347492-350d-45d2-8f79-7e532cfe8d69 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1738 microversion: 2.20 time: 0.173645 Aug 08 02:41:04.982669 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 553/1118] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:04 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:41:06.005715 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a65eaca0-3f1a-43d2-9ec0-b7c611ac9a5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:06.006524 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a65eaca0-3f1a-43d2-9ec0-b7c611ac9a5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:06.013475 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a65eaca0-3f1a-43d2-9ec0-b7c611ac9a5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:06.013988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a65eaca0-3f1a-43d2-9ec0-b7c611ac9a5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:06.014488 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a65eaca0-3f1a-43d2-9ec0-b7c611ac9a5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:06.015315 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a65eaca0-3f1a-43d2-9ec0-b7c611ac9a5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:06.015768 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a65eaca0-3f1a-43d2-9ec0-b7c611ac9a5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:06.016193 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a65eaca0-3f1a-43d2-9ec0-b7c611ac9a5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:06.152936 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a65eaca0-3f1a-43d2-9ec0-b7c611ac9a5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:06.161880 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a65eaca0-3f1a-43d2-9ec0-b7c611ac9a5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:06.163848 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a65eaca0-3f1a-43d2-9ec0-b7c611ac9a5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:06.164578 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a65eaca0-3f1a-43d2-9ec0-b7c611ac9a5b tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1738 microversion: 2.20 time: 0.163542 Aug 08 02:41:06.165162 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 566/1119] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:05 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:07.192229 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0d996be3-fcf3-46d0-b337-aa6068a0e15a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:07.193039 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0d996be3-fcf3-46d0-b337-aa6068a0e15a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:07.201038 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d996be3-fcf3-46d0-b337-aa6068a0e15a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:07.201520 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d996be3-fcf3-46d0-b337-aa6068a0e15a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:07.201949 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d996be3-fcf3-46d0-b337-aa6068a0e15a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:07.202674 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d996be3-fcf3-46d0-b337-aa6068a0e15a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:07.203124 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d996be3-fcf3-46d0-b337-aa6068a0e15a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:07.203554 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d996be3-fcf3-46d0-b337-aa6068a0e15a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:07.352633 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d996be3-fcf3-46d0-b337-aa6068a0e15a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:07.360583 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d996be3-fcf3-46d0-b337-aa6068a0e15a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:07.362287 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d996be3-fcf3-46d0-b337-aa6068a0e15a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:07.363453 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0d996be3-fcf3-46d0-b337-aa6068a0e15a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1738 microversion: 2.20 time: 0.175659 Aug 08 02:41:07.364009 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 554/1120] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:07 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:08.147439 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3b696db7-a131-4642-af22-248eb3f91537 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:08.148610 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3b696db7-a131-4642-af22-248eb3f91537 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:08.159778 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3b696db7-a131-4642-af22-248eb3f91537 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:08.160262 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3b696db7-a131-4642-af22-248eb3f91537 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:08.160694 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3b696db7-a131-4642-af22-248eb3f91537 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:08.161397 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3b696db7-a131-4642-af22-248eb3f91537 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:08.161846 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3b696db7-a131-4642-af22-248eb3f91537 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:08.162287 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3b696db7-a131-4642-af22-248eb3f91537 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:08.188822 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3b696db7-a131-4642-af22-248eb3f91537 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:41:08.272758 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3b696db7-a131-4642-af22-248eb3f91537 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 204 len: 0 microversion: 2.1 time: 0.129534 Aug 08 02:41:08.278065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 567/1121] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:41:08 2022] DELETE /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:41:08.284300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c7dee5b6-eb7e-4c4f-9db7-24c5b208de0f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:08.284930 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c7dee5b6-eb7e-4c4f-9db7-24c5b208de0f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:08.292769 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7dee5b6-eb7e-4c4f-9db7-24c5b208de0f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:08.293253 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7dee5b6-eb7e-4c4f-9db7-24c5b208de0f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:08.293680 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7dee5b6-eb7e-4c4f-9db7-24c5b208de0f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:08.294401 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7dee5b6-eb7e-4c4f-9db7-24c5b208de0f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:08.294849 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7dee5b6-eb7e-4c4f-9db7-24c5b208de0f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:08.295274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7dee5b6-eb7e-4c4f-9db7-24c5b208de0f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:08.386996 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fc6d4426-2b63-4265-a835-b69618f0101d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:08.387743 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-fc6d4426-2b63-4265-a835-b69618f0101d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:08.394112 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fc6d4426-2b63-4265-a835-b69618f0101d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:08.394855 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fc6d4426-2b63-4265-a835-b69618f0101d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:08.395118 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fc6d4426-2b63-4265-a835-b69618f0101d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:08.396514 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fc6d4426-2b63-4265-a835-b69618f0101d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:08.396987 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fc6d4426-2b63-4265-a835-b69618f0101d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:08.397504 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fc6d4426-2b63-4265-a835-b69618f0101d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:08.461095 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c7dee5b6-eb7e-4c4f-9db7-24c5b208de0f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:08.469614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c7dee5b6-eb7e-4c4f-9db7-24c5b208de0f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1575 microversion: 2.1 time: 0.190130 Aug 08 02:41:08.470479 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 555/1122] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:08 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:08.543129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-fc6d4426-2b63-4265-a835-b69618f0101d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:08.545376 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:08.552871 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-fc6d4426-2b63-4265-a835-b69618f0101d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:08.554382 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-fc6d4426-2b63-4265-a835-b69618f0101d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:08.555523 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fc6d4426-2b63-4265-a835-b69618f0101d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1738 microversion: 2.20 time: 0.172916 Aug 08 02:41:08.556075 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 568/1123] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:08 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:41:09.491830 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-be9ebd6a-dc31-43cf-9fcd-2b4baa5b133b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:09.492441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-be9ebd6a-dc31-43cf-9fcd-2b4baa5b133b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:09.498857 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be9ebd6a-dc31-43cf-9fcd-2b4baa5b133b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:09.499328 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be9ebd6a-dc31-43cf-9fcd-2b4baa5b133b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:09.499761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be9ebd6a-dc31-43cf-9fcd-2b4baa5b133b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:09.500437 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be9ebd6a-dc31-43cf-9fcd-2b4baa5b133b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:09.500881 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be9ebd6a-dc31-43cf-9fcd-2b4baa5b133b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:09.501296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be9ebd6a-dc31-43cf-9fcd-2b4baa5b133b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:09.578559 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d47514e2-059e-4dae-9592-787ebfa4f1fa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:09.579281 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d47514e2-059e-4dae-9592-787ebfa4f1fa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:09.582273 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:09.589148 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d47514e2-059e-4dae-9592-787ebfa4f1fa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:09.589637 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d47514e2-059e-4dae-9592-787ebfa4f1fa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:09.590069 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d47514e2-059e-4dae-9592-787ebfa4f1fa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:09.590795 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d47514e2-059e-4dae-9592-787ebfa4f1fa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:09.591245 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d47514e2-059e-4dae-9592-787ebfa4f1fa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:09.591666 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d47514e2-059e-4dae-9592-787ebfa4f1fa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:09.636283 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-be9ebd6a-dc31-43cf-9fcd-2b4baa5b133b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:09.645194 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-be9ebd6a-dc31-43cf-9fcd-2b4baa5b133b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1575 microversion: 2.1 time: 0.156784 Aug 08 02:41:09.646026 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 556/1124] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:09 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:09.723337 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d47514e2-059e-4dae-9592-787ebfa4f1fa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:09.731408 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d47514e2-059e-4dae-9592-787ebfa4f1fa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:09.732911 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d47514e2-059e-4dae-9592-787ebfa4f1fa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:09.734067 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d47514e2-059e-4dae-9592-787ebfa4f1fa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1738 microversion: 2.20 time: 0.159472 Aug 08 02:41:09.734655 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 569/1125] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:09 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:41:10.666076 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d225b779-3718-4ee2-a3d7-391c0e6a9fd1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:10.666725 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d225b779-3718-4ee2-a3d7-391c0e6a9fd1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:10.673161 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d225b779-3718-4ee2-a3d7-391c0e6a9fd1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:10.673653 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d225b779-3718-4ee2-a3d7-391c0e6a9fd1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:10.674090 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d225b779-3718-4ee2-a3d7-391c0e6a9fd1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:10.674861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d225b779-3718-4ee2-a3d7-391c0e6a9fd1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:10.675359 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d225b779-3718-4ee2-a3d7-391c0e6a9fd1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:10.675790 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d225b779-3718-4ee2-a3d7-391c0e6a9fd1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:10.679876 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:10.759188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-cacdd3da-c05e-421f-ae88-0829233c2faf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:10.760035 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-cacdd3da-c05e-421f-ae88-0829233c2faf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:10.766754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cacdd3da-c05e-421f-ae88-0829233c2faf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:10.767345 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cacdd3da-c05e-421f-ae88-0829233c2faf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:10.767851 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cacdd3da-c05e-421f-ae88-0829233c2faf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:10.769226 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cacdd3da-c05e-421f-ae88-0829233c2faf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:10.769748 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cacdd3da-c05e-421f-ae88-0829233c2faf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:10.770562 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cacdd3da-c05e-421f-ae88-0829233c2faf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:10.809998 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d225b779-3718-4ee2-a3d7-391c0e6a9fd1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:10.818384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d225b779-3718-4ee2-a3d7-391c0e6a9fd1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1575 microversion: 2.1 time: 0.156198 Aug 08 02:41:10.819041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 557/1126] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:10 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:11.050340 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-cacdd3da-c05e-421f-ae88-0829233c2faf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:11.058911 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-cacdd3da-c05e-421f-ae88-0829233c2faf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:11.060414 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-cacdd3da-c05e-421f-ae88-0829233c2faf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:11.061594 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-cacdd3da-c05e-421f-ae88-0829233c2faf tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1720 microversion: 2.20 time: 0.306255 Aug 08 02:41:11.062507 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 570/1127] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:10 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1720 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:41:11.839062 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ba8e3efb-148f-4a7f-a187-75de502401b3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:11.839675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ba8e3efb-148f-4a7f-a187-75de502401b3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:11.841939 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=33 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:11.847893 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba8e3efb-148f-4a7f-a187-75de502401b3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:11.848376 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba8e3efb-148f-4a7f-a187-75de502401b3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:11.848825 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba8e3efb-148f-4a7f-a187-75de502401b3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:11.849503 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba8e3efb-148f-4a7f-a187-75de502401b3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:11.849950 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba8e3efb-148f-4a7f-a187-75de502401b3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:11.850400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba8e3efb-148f-4a7f-a187-75de502401b3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:11.914415 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ba8e3efb-148f-4a7f-a187-75de502401b3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:11.922637 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ba8e3efb-148f-4a7f-a187-75de502401b3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1508 microversion: 2.1 time: 0.087389 Aug 08 02:41:11.923237 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 558/1128] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:11 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1508 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:12.084957 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1e9aa4c7-a401-457b-adf6-77208aaf014e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:12.086330 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1e9aa4c7-a401-457b-adf6-77208aaf014e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:12.093648 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e9aa4c7-a401-457b-adf6-77208aaf014e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:12.094535 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e9aa4c7-a401-457b-adf6-77208aaf014e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:12.095193 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e9aa4c7-a401-457b-adf6-77208aaf014e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:12.096204 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e9aa4c7-a401-457b-adf6-77208aaf014e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:12.097413 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e9aa4c7-a401-457b-adf6-77208aaf014e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:12.098065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e9aa4c7-a401-457b-adf6-77208aaf014e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:12.267710 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-23210c58-4d61-4dab-a9f6-7984a2e791d6 req-c0a98a68-ff89-413c-88e2-cfa38bd71c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eee5906-f8e7-4294-8d31-0a12e9a69bb0", "name": "network-vif-deleted", "tag": "493db5d9-4de4-48ec-81f6-b22bbf117145"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:12.277236 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-23210c58-4d61-4dab-a9f6-7984a2e791d6 req-c0a98a68-ff89-413c-88e2-cfa38bd71c2f service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:12.277726 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-23210c58-4d61-4dab-a9f6-7984a2e791d6 req-c0a98a68-ff89-413c-88e2-cfa38bd71c2f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:12.278136 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-23210c58-4d61-4dab-a9f6-7984a2e791d6 req-c0a98a68-ff89-413c-88e2-cfa38bd71c2f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:12.291075 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-23210c58-4d61-4dab-a9f6-7984a2e791d6 req-c0a98a68-ff89-413c-88e2-cfa38bd71c2f service nova] Creating event network-vif-deleted:493db5d9-4de4-48ec-81f6-b22bbf117145 for instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 on hv-cinder-73306 Aug 08 02:41:12.296393 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-23210c58-4d61-4dab-a9f6-7984a2e791d6 req-c0a98a68-ff89-413c-88e2-cfa38bd71c2f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032660 Aug 08 02:41:12.296999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 559/1129] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:41:12.337178 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1e9aa4c7-a401-457b-adf6-77208aaf014e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:12.345319 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1e9aa4c7-a401-457b-adf6-77208aaf014e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:12.346861 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1e9aa4c7-a401-457b-adf6-77208aaf014e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:12.348007 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1e9aa4c7-a401-457b-adf6-77208aaf014e tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1720 microversion: 2.20 time: 0.267033 Aug 08 02:41:12.348558 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 571/1130] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:12 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1720 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:12.666117 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-83a22d04-3ee2-44b5-ab9d-049df5bb26a8 req-0893d011-cdd4-4119-b643-b204c2c95c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19534a66-fc42-4903-9b95-0dc0cacc67c9", "name": "network-vif-unplugged", "status": "completed", "tag": "cc4cfde3-9c47-4a92-a836-463545af627c"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:12.676274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-83a22d04-3ee2-44b5-ab9d-049df5bb26a8 req-0893d011-cdd4-4119-b643-b204c2c95c76 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:12.676777 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-83a22d04-3ee2-44b5-ab9d-049df5bb26a8 req-0893d011-cdd4-4119-b643-b204c2c95c76 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:12.677172 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-83a22d04-3ee2-44b5-ab9d-049df5bb26a8 req-0893d011-cdd4-4119-b643-b204c2c95c76 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:12.688541 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-83a22d04-3ee2-44b5-ab9d-049df5bb26a8 req-0893d011-cdd4-4119-b643-b204c2c95c76 service nova] Creating event network-vif-unplugged:cc4cfde3-9c47-4a92-a836-463545af627c for instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 on hv-cinder-73306 Aug 08 02:41:12.693912 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-83a22d04-3ee2-44b5-ab9d-049df5bb26a8 req-0893d011-cdd4-4119-b643-b204c2c95c76 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032137 Aug 08 02:41:12.694536 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 560/1131] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:41:12.944163 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-896ee320-1791-41e2-9b14-88f09909a5ec tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:12.944862 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-896ee320-1791-41e2-9b14-88f09909a5ec tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:12.950853 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-896ee320-1791-41e2-9b14-88f09909a5ec tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:12.951340 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-896ee320-1791-41e2-9b14-88f09909a5ec tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:12.951773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-896ee320-1791-41e2-9b14-88f09909a5ec tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:12.952468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-896ee320-1791-41e2-9b14-88f09909a5ec tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:12.952920 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-896ee320-1791-41e2-9b14-88f09909a5ec tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:12.953341 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-896ee320-1791-41e2-9b14-88f09909a5ec tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:13.021829 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-896ee320-1791-41e2-9b14-88f09909a5ec tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:13.029653 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-896ee320-1791-41e2-9b14-88f09909a5ec tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 200 len: 1508 microversion: 2.1 time: 0.089590 Aug 08 02:41:13.030220 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 572/1132] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:12 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 1508 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:13.373506 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-445feb09-4540-4630-b5dd-899b704c58c5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:13.374696 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-445feb09-4540-4630-b5dd-899b704c58c5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:13.384734 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-445feb09-4540-4630-b5dd-899b704c58c5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:13.385310 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-445feb09-4540-4630-b5dd-899b704c58c5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:13.385820 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-445feb09-4540-4630-b5dd-899b704c58c5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:13.386867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-445feb09-4540-4630-b5dd-899b704c58c5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:13.387622 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-445feb09-4540-4630-b5dd-899b704c58c5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:13.388335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-445feb09-4540-4630-b5dd-899b704c58c5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:13.524003 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-445feb09-4540-4630-b5dd-899b704c58c5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:13.531835 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-445feb09-4540-4630-b5dd-899b704c58c5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:13.533328 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-445feb09-4540-4630-b5dd-899b704c58c5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:13.535014 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-445feb09-4540-4630-b5dd-899b704c58c5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1723 microversion: 2.20 time: 0.167141 Aug 08 02:41:13.535564 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 561/1133] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:13 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:41:13.557745 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b3049b48-c1e7-40e9-afb6-c4932c430843 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c4364ff-ca79-42b0-adbd-1395f5330a2d"}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:13.560087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b3049b48-c1e7-40e9-afb6-c4932c430843 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:13.566817 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b3049b48-c1e7-40e9-afb6-c4932c430843 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:13.567482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b3049b48-c1e7-40e9-afb6-c4932c430843 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:13.567927 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b3049b48-c1e7-40e9-afb6-c4932c430843 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:13.568620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b3049b48-c1e7-40e9-afb6-c4932c430843 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:13.569075 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b3049b48-c1e7-40e9-afb6-c4932c430843 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:13.569496 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b3049b48-c1e7-40e9-afb6-c4932c430843 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:13.850663 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b3049b48-c1e7-40e9-afb6-c4932c430843 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "POST /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296910 Aug 08 02:41:13.851254 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 573/1134] 10.222.0.39 () {62 vars in 1364 bytes} [Mon Aug 8 02:41:13 2022] POST /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 02:41:13.976760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4158624e-4bf6-4515-b492-423fa6d7b6e2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:13.977260 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4158624e-4bf6-4515-b492-423fa6d7b6e2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:13.983659 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4158624e-4bf6-4515-b492-423fa6d7b6e2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:13.984141 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4158624e-4bf6-4515-b492-423fa6d7b6e2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:13.984599 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4158624e-4bf6-4515-b492-423fa6d7b6e2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:13.985289 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4158624e-4bf6-4515-b492-423fa6d7b6e2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:13.985783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4158624e-4bf6-4515-b492-423fa6d7b6e2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:13.986232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4158624e-4bf6-4515-b492-423fa6d7b6e2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:14.055549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dd4d33c4-4a0c-4632-958b-731fbb0d4353 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:14.056705 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-dd4d33c4-4a0c-4632-958b-731fbb0d4353 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:14.065041 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dd4d33c4-4a0c-4632-958b-731fbb0d4353 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:14.066111 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dd4d33c4-4a0c-4632-958b-731fbb0d4353 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:14.066676 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dd4d33c4-4a0c-4632-958b-731fbb0d4353 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:14.067575 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dd4d33c4-4a0c-4632-958b-731fbb0d4353 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:14.068127 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dd4d33c4-4a0c-4632-958b-731fbb0d4353 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:14.068665 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dd4d33c4-4a0c-4632-958b-731fbb0d4353 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:14.083429 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-dd4d33c4-4a0c-4632-958b-731fbb0d4353 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] HTTP exception thrown: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dd4d33c4-4a0c-4632-958b-731fbb0d4353 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Request method failure captured: Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 HTTP/1.1 Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HbnW1bKKkrNq6zEtQYhDDRJSfCqNxOxPICbvx5fP7MXfaBVmaM9VtIQcpaHIipyB9FapKtZtoeXEz3onz76-UFI25F82VpH4eCKFDk8__fhNHf_pPmAU3oUDmLTHzlp4sTHUIS-BZ8w0S4DuM0g2FEWqWP0A8Jacsd9bodf5lRf87U Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 7a06a8947bd84ac398bf498d8816717c Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:41:14.085087 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:41:14.086791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a06a8947bd84ac398bf498d8816717c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a06a8947bd84ac398bf498d8816717c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a06a8947bd84ac398bf498d8816717c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a06a8947bd84ac398bf498d8816717c"}]}] Aug 08 02:41:14.086791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:41:14.086791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 7a06a8947bd84ac398bf498d8816717c Aug 08 02:41:14.086791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:41:14.086791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-TestVolumeBootPattern-1786949426-project Aug 08 02:41:14.086791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:41:14.086791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:41:14.086791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 72485bc9ed6f4684b77b617597f99e29 Aug 08 02:41:14.086791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-TestVolumeBootPattern-1786949426-project Aug 08 02:41:14.086791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:41:14.086791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:41:14.086791 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '7eee5906-f8e7-4294-8d31-0a12e9a69bb0'} Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:41:14.087805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:41:14.089169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:41:14.090410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dd4d33c4-4a0c-4632-958b-731fbb0d4353 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Returning 404 to user: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:41:14.090410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-dd4d33c4-4a0c-4632-958b-731fbb0d4353 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 404 len: 111 microversion: 2.1 time: 0.039190 Aug 08 02:41:14.090410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 574/1135] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:14 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 02:41:14.185743 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1386112321", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-819876671", "security_groups": [{"name": "tempest-secgroup-smoke-357897792"}], "block_device_mapping_v2": [{"uuid": "69505825-13b6-4fe2-8e9b-d728ffa5c84a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a2a67ad0-5293-4294-ac4f-5a74fbe89f5a"}]}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:14.231978 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4158624e-4bf6-4515-b492-423fa6d7b6e2 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "DELETE /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/os-volume_attachments/9c4364ff-ca79-42b0-adbd-1395f5330a2d" status: 202 len: 0 microversion: 2.20 time: 0.259798 Aug 08 02:41:14.232586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 562/1136] 10.222.0.39 () {60 vars in 1457 bytes} [Mon Aug 8 02:41:13 2022] DELETE /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/os-volume_attachments/9c4364ff-ca79-42b0-adbd-1395f5330a2d => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:41:14.292680 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-161f29b1-4e0d-422f-a0c8-35e3d975d382 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:14.293579 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-161f29b1-4e0d-422f-a0c8-35e3d975d382 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:14.299803 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-161f29b1-4e0d-422f-a0c8-35e3d975d382 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:14.300061 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-161f29b1-4e0d-422f-a0c8-35e3d975d382 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:14.300495 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-161f29b1-4e0d-422f-a0c8-35e3d975d382 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:14.301173 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.network.neutron [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] validate_networks() for [('a2a67ad0-5293-4294-ac4f-5a74fbe89f5a', None, None, None, None, None)] {{(pid=117640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:41:14.301321 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-161f29b1-4e0d-422f-a0c8-35e3d975d382 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:14.301785 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-161f29b1-4e0d-422f-a0c8-35e3d975d382 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:14.302211 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-161f29b1-4e0d-422f-a0c8-35e3d975d382 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:14.396764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-161f29b1-4e0d-422f-a0c8-35e3d975d382 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117642) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 02:41:14.466667 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-161f29b1-4e0d-422f-a0c8-35e3d975d382 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "POST /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/action" status: 202 len: 0 microversion: 2.20 time: 0.178374 Aug 08 02:41:14.467371 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 563/1137] 10.222.0.39 () {62 vars in 1319 bytes} [Mon Aug 8 02:41:14 2022] POST /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 08 02:41:14.475557 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-22255cfc-d94b-4033-9212-0a9bbd148e7d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:14.476171 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-22255cfc-d94b-4033-9212-0a9bbd148e7d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:14.482387 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-22255cfc-d94b-4033-9212-0a9bbd148e7d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:14.482715 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-22255cfc-d94b-4033-9212-0a9bbd148e7d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:14.483017 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-22255cfc-d94b-4033-9212-0a9bbd148e7d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:14.483714 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-22255cfc-d94b-4033-9212-0a9bbd148e7d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:14.484157 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-22255cfc-d94b-4033-9212-0a9bbd148e7d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:14.484571 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-22255cfc-d94b-4033-9212-0a9bbd148e7d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:14.632795 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-22255cfc-d94b-4033-9212-0a9bbd148e7d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:14.642338 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-22255cfc-d94b-4033-9212-0a9bbd148e7d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:14.644033 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-22255cfc-d94b-4033-9212-0a9bbd148e7d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:14.646133 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-22255cfc-d94b-4033-9212-0a9bbd148e7d tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1671 microversion: 2.20 time: 0.174804 Aug 08 02:41:14.647460 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 564/1138] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:14 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:41:14.692973 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Flavor limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:41:14.693960 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Image limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:41:14.694571 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Flavor pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:41:14.695048 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Image pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:41:14.695632 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:41:14.704510 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:14.705004 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:14.706058 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:14.706822 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:14.707267 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:14.707805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:14.725718 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Getting quotas for project 7a06a8947bd84ac398bf498d8816717c. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:41:14.729825 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Getting quotas for user 72485bc9ed6f4684b77b617597f99e29 and project 7a06a8947bd84ac398bf498d8816717c. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:41:14.787306 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Going to run 1 instances... {{(pid=117640) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:41:14.789572 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69505825-13b6-4fe2-8e9b-d728ffa5c84a',volume_size=None,volume_type=None)] {{(pid=117640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:41:14.925904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8b1e0a83-99ed-4b5a-9e65-9a08b25a81d1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.744017 Aug 08 02:41:14.926898 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 575/1139] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:41:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 02:41:14.937787 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-371d875a-fedd-4545-b356-3b8a7ae6a2c9 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:14.938651 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-371d875a-fedd-4545-b356-3b8a7ae6a2c9 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:15.016953 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-371d875a-fedd-4545-b356-3b8a7ae6a2c9 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:15.026261 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-371d875a-fedd-4545-b356-3b8a7ae6a2c9 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1094 microversion: 2.1 time: 0.092149 Aug 08 02:41:15.027026 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 565/1140] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:14 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:15.669520 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2246b350-4bb4-4622-8ef4-acd2b907e9ec tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:15.670133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2246b350-4bb4-4622-8ef4-acd2b907e9ec tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:15.677798 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2246b350-4bb4-4622-8ef4-acd2b907e9ec tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:15.678299 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2246b350-4bb4-4622-8ef4-acd2b907e9ec tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:15.678737 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2246b350-4bb4-4622-8ef4-acd2b907e9ec tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:15.679454 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2246b350-4bb4-4622-8ef4-acd2b907e9ec tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:15.679904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2246b350-4bb4-4622-8ef4-acd2b907e9ec tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:15.680330 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2246b350-4bb4-4622-8ef4-acd2b907e9ec tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:15.814579 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2246b350-4bb4-4622-8ef4-acd2b907e9ec tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:15.822861 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2246b350-4bb4-4622-8ef4-acd2b907e9ec tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:15.824345 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2246b350-4bb4-4622-8ef4-acd2b907e9ec tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:15.825489 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2246b350-4bb4-4622-8ef4-acd2b907e9ec tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.160004 Aug 08 02:41:15.826036 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 576/1141] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:15 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:16.047603 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-293bc828-db5d-4807-b15d-b4fb4961994d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:16.048157 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-293bc828-db5d-4807-b15d-b4fb4961994d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:16.055629 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-293bc828-db5d-4807-b15d-b4fb4961994d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:16.056100 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-293bc828-db5d-4807-b15d-b4fb4961994d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:16.056528 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-293bc828-db5d-4807-b15d-b4fb4961994d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:16.057203 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-293bc828-db5d-4807-b15d-b4fb4961994d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:16.057649 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-293bc828-db5d-4807-b15d-b4fb4961994d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:16.058066 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-293bc828-db5d-4807-b15d-b4fb4961994d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:16.123254 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-293bc828-db5d-4807-b15d-b4fb4961994d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:16.131012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-293bc828-db5d-4807-b15d-b4fb4961994d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1200 microversion: 2.1 time: 0.087333 Aug 08 02:41:16.131896 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 566/1142] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:16 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:16.848870 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-c5575257-9a4b-4ddc-94b0-3198a6106f91 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:16.849478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-c5575257-9a4b-4ddc-94b0-3198a6106f91 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:16.856203 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c5575257-9a4b-4ddc-94b0-3198a6106f91 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:16.856959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c5575257-9a4b-4ddc-94b0-3198a6106f91 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:16.857388 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c5575257-9a4b-4ddc-94b0-3198a6106f91 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:16.858071 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c5575257-9a4b-4ddc-94b0-3198a6106f91 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:16.858584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c5575257-9a4b-4ddc-94b0-3198a6106f91 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:16.859175 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-c5575257-9a4b-4ddc-94b0-3198a6106f91 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:17.152479 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-199f00ba-a32a-4b46-a08f-d7e90727f689 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:17.153104 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-199f00ba-a32a-4b46-a08f-d7e90727f689 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:17.154567 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c5575257-9a4b-4ddc-94b0-3198a6106f91 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:17.162062 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199f00ba-a32a-4b46-a08f-d7e90727f689 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:17.162606 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199f00ba-a32a-4b46-a08f-d7e90727f689 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:17.163049 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199f00ba-a32a-4b46-a08f-d7e90727f689 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:17.163758 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199f00ba-a32a-4b46-a08f-d7e90727f689 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:17.164217 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199f00ba-a32a-4b46-a08f-d7e90727f689 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:17.164439 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c5575257-9a4b-4ddc-94b0-3198a6106f91 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:17.164638 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-199f00ba-a32a-4b46-a08f-d7e90727f689 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:17.165933 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-c5575257-9a4b-4ddc-94b0-3198a6106f91 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:17.168300 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-c5575257-9a4b-4ddc-94b0-3198a6106f91 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.323287 Aug 08 02:41:17.169050 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 577/1143] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:16 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:17.233163 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-199f00ba-a32a-4b46-a08f-d7e90727f689 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:17.243416 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-199f00ba-a32a-4b46-a08f-d7e90727f689 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1198 microversion: 2.1 time: 0.094700 Aug 08 02:41:17.244049 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 567/1144] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:17 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1198 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:18.086715 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-d05d71b4-defd-4307-8899-cea50b775fb4 req-41dda7a9-11cb-47a6-8875-9000fab9d4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800f1d48-496a-4d2b-93b3-f9d65ae6e824", "tag": "a0d07287-712e-4449-a18d-cf15f3307426"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:18.101547 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-d05d71b4-defd-4307-8899-cea50b775fb4 req-41dda7a9-11cb-47a6-8875-9000fab9d4a7 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:18.102346 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-d05d71b4-defd-4307-8899-cea50b775fb4 req-41dda7a9-11cb-47a6-8875-9000fab9d4a7 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:18.102971 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-d05d71b4-defd-4307-8899-cea50b775fb4 req-41dda7a9-11cb-47a6-8875-9000fab9d4a7 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:18.114883 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-d05d71b4-defd-4307-8899-cea50b775fb4 req-41dda7a9-11cb-47a6-8875-9000fab9d4a7 service nova] Creating event network-changed:a0d07287-712e-4449-a18d-cf15f3307426 for instance 800f1d48-496a-4d2b-93b3-f9d65ae6e824 on hv-cinder-73306 Aug 08 02:41:18.120400 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-d05d71b4-defd-4307-8899-cea50b775fb4 req-41dda7a9-11cb-47a6-8875-9000fab9d4a7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038443 Aug 08 02:41:18.121522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 578/1145] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:41:18.192061 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e4ea0702-7ee4-4d8c-9e32-131f89cc70aa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:18.193287 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e4ea0702-7ee4-4d8c-9e32-131f89cc70aa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:18.208037 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4ea0702-7ee4-4d8c-9e32-131f89cc70aa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:18.208527 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4ea0702-7ee4-4d8c-9e32-131f89cc70aa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:18.208988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4ea0702-7ee4-4d8c-9e32-131f89cc70aa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:18.209694 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4ea0702-7ee4-4d8c-9e32-131f89cc70aa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:18.210139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4ea0702-7ee4-4d8c-9e32-131f89cc70aa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:18.210587 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4ea0702-7ee4-4d8c-9e32-131f89cc70aa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:18.265566 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-180d02cb-b10d-4e0d-922e-c2b9e42eba73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:18.266763 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-180d02cb-b10d-4e0d-922e-c2b9e42eba73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:18.275136 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-180d02cb-b10d-4e0d-922e-c2b9e42eba73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:18.275741 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-180d02cb-b10d-4e0d-922e-c2b9e42eba73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:18.276256 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-180d02cb-b10d-4e0d-922e-c2b9e42eba73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:18.277039 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-180d02cb-b10d-4e0d-922e-c2b9e42eba73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:18.284555 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-180d02cb-b10d-4e0d-922e-c2b9e42eba73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:18.284555 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-180d02cb-b10d-4e0d-922e-c2b9e42eba73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:18.392007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e4ea0702-7ee4-4d8c-9e32-131f89cc70aa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:18.401710 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e4ea0702-7ee4-4d8c-9e32-131f89cc70aa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:18.403251 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e4ea0702-7ee4-4d8c-9e32-131f89cc70aa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:18.404409 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e4ea0702-7ee4-4d8c-9e32-131f89cc70aa tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.217335 Aug 08 02:41:18.405875 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 568/1146] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:18 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:41:18.451338 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-180d02cb-b10d-4e0d-922e-c2b9e42eba73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:18.459930 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-180d02cb-b10d-4e0d-922e-c2b9e42eba73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.198898 Aug 08 02:41:18.460507 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 579/1147] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:18 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:19.427981 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0d22a52b-56be-4e10-ba8a-33eb1cac89a1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:19.428567 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0d22a52b-56be-4e10-ba8a-33eb1cac89a1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:19.435219 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d22a52b-56be-4e10-ba8a-33eb1cac89a1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:19.435701 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d22a52b-56be-4e10-ba8a-33eb1cac89a1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:19.436136 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d22a52b-56be-4e10-ba8a-33eb1cac89a1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:19.436835 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d22a52b-56be-4e10-ba8a-33eb1cac89a1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:19.437288 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d22a52b-56be-4e10-ba8a-33eb1cac89a1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:19.437712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d22a52b-56be-4e10-ba8a-33eb1cac89a1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:19.480799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-8330b7bb-bfc4-477b-8ee5-c5e25890e078 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:19.481470 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-8330b7bb-bfc4-477b-8ee5-c5e25890e078 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:19.488418 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8330b7bb-bfc4-477b-8ee5-c5e25890e078 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:19.488900 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8330b7bb-bfc4-477b-8ee5-c5e25890e078 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:19.489552 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8330b7bb-bfc4-477b-8ee5-c5e25890e078 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:19.490481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8330b7bb-bfc4-477b-8ee5-c5e25890e078 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:19.490937 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8330b7bb-bfc4-477b-8ee5-c5e25890e078 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:19.491366 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-8330b7bb-bfc4-477b-8ee5-c5e25890e078 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:19.595820 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d22a52b-56be-4e10-ba8a-33eb1cac89a1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:19.608470 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d22a52b-56be-4e10-ba8a-33eb1cac89a1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:19.609999 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0d22a52b-56be-4e10-ba8a-33eb1cac89a1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:19.611219 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0d22a52b-56be-4e10-ba8a-33eb1cac89a1 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.187194 Aug 08 02:41:19.618222 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 569/1148] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:19 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:41:19.645317 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-8330b7bb-bfc4-477b-8ee5-c5e25890e078 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:19.653398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-8330b7bb-bfc4-477b-8ee5-c5e25890e078 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.176394 Aug 08 02:41:19.654277 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 580/1149] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:19 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:20.635853 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6a40f198-38d8-4cd5-acb3-aaf097fd5cc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:20.636862 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6a40f198-38d8-4cd5-acb3-aaf097fd5cc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:20.644295 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a40f198-38d8-4cd5-acb3-aaf097fd5cc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:20.644866 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a40f198-38d8-4cd5-acb3-aaf097fd5cc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:20.645509 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a40f198-38d8-4cd5-acb3-aaf097fd5cc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:20.646451 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a40f198-38d8-4cd5-acb3-aaf097fd5cc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:20.647092 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a40f198-38d8-4cd5-acb3-aaf097fd5cc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:20.647696 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a40f198-38d8-4cd5-acb3-aaf097fd5cc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:20.676436 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2c3b98b8-cb56-47a5-91fc-72a137153c73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:20.677104 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2c3b98b8-cb56-47a5-91fc-72a137153c73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:20.683818 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c3b98b8-cb56-47a5-91fc-72a137153c73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:20.684522 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c3b98b8-cb56-47a5-91fc-72a137153c73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:20.685129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c3b98b8-cb56-47a5-91fc-72a137153c73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:20.685991 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c3b98b8-cb56-47a5-91fc-72a137153c73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:20.686616 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c3b98b8-cb56-47a5-91fc-72a137153c73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:20.687200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2c3b98b8-cb56-47a5-91fc-72a137153c73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:20.810033 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6a40f198-38d8-4cd5-acb3-aaf097fd5cc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:20.819177 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6a40f198-38d8-4cd5-acb3-aaf097fd5cc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:20.822279 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6a40f198-38d8-4cd5-acb3-aaf097fd5cc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:20.824643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6a40f198-38d8-4cd5-acb3-aaf097fd5cc5 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.192743 Aug 08 02:41:20.825232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 570/1150] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:20 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:20.863451 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2c3b98b8-cb56-47a5-91fc-72a137153c73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:20.871503 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2c3b98b8-cb56-47a5-91fc-72a137153c73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.199743 Aug 08 02:41:20.872073 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 581/1151] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:20 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:21.848430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9f5b89ee-47af-4601-a99f-20282e471330 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:21.849038 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9f5b89ee-47af-4601-a99f-20282e471330 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:21.855889 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f5b89ee-47af-4601-a99f-20282e471330 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:21.856397 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f5b89ee-47af-4601-a99f-20282e471330 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:21.856861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f5b89ee-47af-4601-a99f-20282e471330 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:21.857581 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f5b89ee-47af-4601-a99f-20282e471330 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:21.858056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f5b89ee-47af-4601-a99f-20282e471330 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:21.858507 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f5b89ee-47af-4601-a99f-20282e471330 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:21.892207 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0b685e95-5e97-4c1b-b20f-f2bf40b73d7f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:21.893456 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0b685e95-5e97-4c1b-b20f-f2bf40b73d7f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:21.900782 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b685e95-5e97-4c1b-b20f-f2bf40b73d7f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:21.901266 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b685e95-5e97-4c1b-b20f-f2bf40b73d7f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:21.901703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b685e95-5e97-4c1b-b20f-f2bf40b73d7f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:21.902444 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b685e95-5e97-4c1b-b20f-f2bf40b73d7f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:21.902896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b685e95-5e97-4c1b-b20f-f2bf40b73d7f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:21.903344 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0b685e95-5e97-4c1b-b20f-f2bf40b73d7f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:22.021020 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9f5b89ee-47af-4601-a99f-20282e471330 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:22.029860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9f5b89ee-47af-4601-a99f-20282e471330 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:22.031411 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9f5b89ee-47af-4601-a99f-20282e471330 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:22.032580 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9f5b89ee-47af-4601-a99f-20282e471330 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.188553 Aug 08 02:41:22.033155 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 571/1152] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:21 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:22.068177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-0b685e95-5e97-4c1b-b20f-f2bf40b73d7f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:22.076526 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0b685e95-5e97-4c1b-b20f-f2bf40b73d7f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.188442 Aug 08 02:41:22.077083 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 582/1153] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:21 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:23.063555 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8e6839c6-572b-4779-9e35-cb1c284ec359 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:23.064243 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8e6839c6-572b-4779-9e35-cb1c284ec359 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:23.071104 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e6839c6-572b-4779-9e35-cb1c284ec359 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:23.071582 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e6839c6-572b-4779-9e35-cb1c284ec359 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:23.072008 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e6839c6-572b-4779-9e35-cb1c284ec359 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:23.072698 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e6839c6-572b-4779-9e35-cb1c284ec359 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:23.073142 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e6839c6-572b-4779-9e35-cb1c284ec359 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:23.073679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e6839c6-572b-4779-9e35-cb1c284ec359 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:23.096490 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-798a9a1b-aadb-4010-8951-4922a629537b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:23.098568 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-798a9a1b-aadb-4010-8951-4922a629537b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:23.108521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-798a9a1b-aadb-4010-8951-4922a629537b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:23.109386 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-798a9a1b-aadb-4010-8951-4922a629537b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:23.110042 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-798a9a1b-aadb-4010-8951-4922a629537b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:23.110986 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-798a9a1b-aadb-4010-8951-4922a629537b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:23.111668 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-798a9a1b-aadb-4010-8951-4922a629537b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:23.112311 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-798a9a1b-aadb-4010-8951-4922a629537b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:23.269612 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8e6839c6-572b-4779-9e35-cb1c284ec359 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:23.272036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:23.279485 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8e6839c6-572b-4779-9e35-cb1c284ec359 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:23.281388 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8e6839c6-572b-4779-9e35-cb1c284ec359 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:23.291237 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8e6839c6-572b-4779-9e35-cb1c284ec359 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.231145 Aug 08 02:41:23.306284 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 572/1154] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:23 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:23.306661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-798a9a1b-aadb-4010-8951-4922a629537b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:23.308846 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-798a9a1b-aadb-4010-8951-4922a629537b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.216552 Aug 08 02:41:23.309425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 583/1155] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:23 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:24.318457 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3e2394db-b506-49f8-a452-1f571ec8cc2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:24.319140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3e2394db-b506-49f8-a452-1f571ec8cc2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:24.331046 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-762cb4e6-3eef-420c-ac3e-f4a629f1a2f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:24.333049 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-762cb4e6-3eef-420c-ac3e-f4a629f1a2f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:24.333249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e2394db-b506-49f8-a452-1f571ec8cc2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:24.334041 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e2394db-b506-49f8-a452-1f571ec8cc2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:24.334133 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e2394db-b506-49f8-a452-1f571ec8cc2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:24.334888 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e2394db-b506-49f8-a452-1f571ec8cc2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:24.335297 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e2394db-b506-49f8-a452-1f571ec8cc2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:24.335717 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e2394db-b506-49f8-a452-1f571ec8cc2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:24.343071 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-762cb4e6-3eef-420c-ac3e-f4a629f1a2f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:24.343849 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-762cb4e6-3eef-420c-ac3e-f4a629f1a2f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:24.344502 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-762cb4e6-3eef-420c-ac3e-f4a629f1a2f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:24.345559 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-762cb4e6-3eef-420c-ac3e-f4a629f1a2f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:24.346218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-762cb4e6-3eef-420c-ac3e-f4a629f1a2f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:24.346968 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-762cb4e6-3eef-420c-ac3e-f4a629f1a2f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:24.540927 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3e2394db-b506-49f8-a452-1f571ec8cc2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:24.553714 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3e2394db-b506-49f8-a452-1f571ec8cc2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:24.555438 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3e2394db-b506-49f8-a452-1f571ec8cc2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:24.556779 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3e2394db-b506-49f8-a452-1f571ec8cc2a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.243556 Aug 08 02:41:24.557790 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 573/1156] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:24 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:24.581294 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-762cb4e6-3eef-420c-ac3e-f4a629f1a2f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:24.583594 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:24.590809 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-762cb4e6-3eef-420c-ac3e-f4a629f1a2f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.263431 Aug 08 02:41:24.591328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 584/1157] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:24 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:25.581396 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-052e8533-a138-4eea-9199-ca2985033186 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:25.582006 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-052e8533-a138-4eea-9199-ca2985033186 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:25.583860 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:25.589371 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-052e8533-a138-4eea-9199-ca2985033186 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:25.589848 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-052e8533-a138-4eea-9199-ca2985033186 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:25.590307 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-052e8533-a138-4eea-9199-ca2985033186 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:25.590994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-052e8533-a138-4eea-9199-ca2985033186 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:25.591441 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-052e8533-a138-4eea-9199-ca2985033186 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:25.591862 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-052e8533-a138-4eea-9199-ca2985033186 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:25.614720 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-20c8b1d5-b3c5-4b10-be20-6df284167df2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:25.615826 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-20c8b1d5-b3c5-4b10-be20-6df284167df2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:25.617984 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:25.618996 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=6 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:25.626119 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-20c8b1d5-b3c5-4b10-be20-6df284167df2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:25.626628 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-20c8b1d5-b3c5-4b10-be20-6df284167df2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:25.627057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-20c8b1d5-b3c5-4b10-be20-6df284167df2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:25.627743 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-20c8b1d5-b3c5-4b10-be20-6df284167df2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:25.628184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-20c8b1d5-b3c5-4b10-be20-6df284167df2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:25.628594 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-20c8b1d5-b3c5-4b10-be20-6df284167df2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:25.726868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-052e8533-a138-4eea-9199-ca2985033186 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:25.734952 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-052e8533-a138-4eea-9199-ca2985033186 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:25.736502 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-052e8533-a138-4eea-9199-ca2985033186 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:25.738216 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-052e8533-a138-4eea-9199-ca2985033186 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.160269 Aug 08 02:41:25.739025 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 574/1158] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:25 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:25.760559 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-20c8b1d5-b3c5-4b10-be20-6df284167df2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:25.767972 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-20c8b1d5-b3c5-4b10-be20-6df284167df2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.159792 Aug 08 02:41:25.768534 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 585/1159] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:25 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:26.760777 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b57e4e06-cd8f-4e16-830e-2b478400772a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:26.761395 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b57e4e06-cd8f-4e16-830e-2b478400772a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:26.767797 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57e4e06-cd8f-4e16-830e-2b478400772a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:26.768274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57e4e06-cd8f-4e16-830e-2b478400772a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:26.768708 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57e4e06-cd8f-4e16-830e-2b478400772a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:26.769389 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57e4e06-cd8f-4e16-830e-2b478400772a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:26.769841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57e4e06-cd8f-4e16-830e-2b478400772a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:26.770273 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57e4e06-cd8f-4e16-830e-2b478400772a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:26.787745 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-38e8b40a-2e68-46e7-b48b-c87c0fdeeb16 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:26.788356 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-38e8b40a-2e68-46e7-b48b-c87c0fdeeb16 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:26.794631 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-38e8b40a-2e68-46e7-b48b-c87c0fdeeb16 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:26.795099 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-38e8b40a-2e68-46e7-b48b-c87c0fdeeb16 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:26.795529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-38e8b40a-2e68-46e7-b48b-c87c0fdeeb16 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:26.796211 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-38e8b40a-2e68-46e7-b48b-c87c0fdeeb16 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:26.796659 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-38e8b40a-2e68-46e7-b48b-c87c0fdeeb16 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:26.797077 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-38e8b40a-2e68-46e7-b48b-c87c0fdeeb16 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:26.905107 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b57e4e06-cd8f-4e16-830e-2b478400772a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:26.913093 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b57e4e06-cd8f-4e16-830e-2b478400772a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:26.914636 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b57e4e06-cd8f-4e16-830e-2b478400772a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:26.915790 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b57e4e06-cd8f-4e16-830e-2b478400772a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.158908 Aug 08 02:41:26.916351 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 575/1160] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:26 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:26.929109 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-38e8b40a-2e68-46e7-b48b-c87c0fdeeb16 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:26.936613 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-38e8b40a-2e68-46e7-b48b-c87c0fdeeb16 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.152771 Aug 08 02:41:26.937173 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 586/1161] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:26 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:27.939146 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ad51d867-b4f1-4519-b16b-a569d67e0c92 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:27.939756 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ad51d867-b4f1-4519-b16b-a569d67e0c92 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:27.946918 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad51d867-b4f1-4519-b16b-a569d67e0c92 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:27.947397 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad51d867-b4f1-4519-b16b-a569d67e0c92 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:27.947828 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad51d867-b4f1-4519-b16b-a569d67e0c92 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:27.948513 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad51d867-b4f1-4519-b16b-a569d67e0c92 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:27.948968 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad51d867-b4f1-4519-b16b-a569d67e0c92 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:27.949387 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad51d867-b4f1-4519-b16b-a569d67e0c92 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:27.957289 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-22ef492a-bde2-4c39-bc01-3ffd30886935 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:27.957894 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-22ef492a-bde2-4c39-bc01-3ffd30886935 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:27.964266 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22ef492a-bde2-4c39-bc01-3ffd30886935 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:27.964740 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22ef492a-bde2-4c39-bc01-3ffd30886935 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:27.965167 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22ef492a-bde2-4c39-bc01-3ffd30886935 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:27.965845 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22ef492a-bde2-4c39-bc01-3ffd30886935 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:27.966317 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22ef492a-bde2-4c39-bc01-3ffd30886935 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:27.966735 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22ef492a-bde2-4c39-bc01-3ffd30886935 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:28.079374 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ad51d867-b4f1-4519-b16b-a569d67e0c92 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:28.088083 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ad51d867-b4f1-4519-b16b-a569d67e0c92 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:28.089583 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ad51d867-b4f1-4519-b16b-a569d67e0c92 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:28.090770 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ad51d867-b4f1-4519-b16b-a569d67e0c92 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.155575 Aug 08 02:41:28.091329 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 576/1162] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:27 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:28.101129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-22ef492a-bde2-4c39-bc01-3ffd30886935 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:28.108620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-22ef492a-bde2-4c39-bc01-3ffd30886935 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.155751 Aug 08 02:41:28.109172 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 587/1163] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:27 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:29.113546 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-984172c1-de7f-45be-93d0-af6370b7bdd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:29.114155 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-984172c1-de7f-45be-93d0-af6370b7bdd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:29.120564 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-984172c1-de7f-45be-93d0-af6370b7bdd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:29.121040 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-984172c1-de7f-45be-93d0-af6370b7bdd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:29.121469 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-984172c1-de7f-45be-93d0-af6370b7bdd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:29.122152 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-984172c1-de7f-45be-93d0-af6370b7bdd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:29.122647 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-984172c1-de7f-45be-93d0-af6370b7bdd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:29.123067 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-984172c1-de7f-45be-93d0-af6370b7bdd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:29.128691 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1396fcec-2a1e-4827-92c4-a473b8191fb8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:29.129294 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1396fcec-2a1e-4827-92c4-a473b8191fb8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:29.135820 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1396fcec-2a1e-4827-92c4-a473b8191fb8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:29.136296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1396fcec-2a1e-4827-92c4-a473b8191fb8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:29.136725 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1396fcec-2a1e-4827-92c4-a473b8191fb8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:29.137412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1396fcec-2a1e-4827-92c4-a473b8191fb8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:29.137863 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1396fcec-2a1e-4827-92c4-a473b8191fb8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:29.138405 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1396fcec-2a1e-4827-92c4-a473b8191fb8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:29.254047 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-984172c1-de7f-45be-93d0-af6370b7bdd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:29.262206 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-984172c1-de7f-45be-93d0-af6370b7bdd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:29.263728 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-984172c1-de7f-45be-93d0-af6370b7bdd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:29.264869 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-984172c1-de7f-45be-93d0-af6370b7bdd9 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.155287 Aug 08 02:41:29.265424 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 577/1164] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:29 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:29.273450 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1396fcec-2a1e-4827-92c4-a473b8191fb8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:29.280939 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1396fcec-2a1e-4827-92c4-a473b8191fb8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.156092 Aug 08 02:41:29.281487 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 588/1165] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:29 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:30.288854 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c75b5879-716e-4d29-ba9f-0f87b367a953 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:30.289502 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c75b5879-716e-4d29-ba9f-0f87b367a953 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:30.295917 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c75b5879-716e-4d29-ba9f-0f87b367a953 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:30.296407 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c75b5879-716e-4d29-ba9f-0f87b367a953 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:30.296928 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c75b5879-716e-4d29-ba9f-0f87b367a953 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:30.297626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c75b5879-716e-4d29-ba9f-0f87b367a953 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:30.298087 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c75b5879-716e-4d29-ba9f-0f87b367a953 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:30.298608 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c75b5879-716e-4d29-ba9f-0f87b367a953 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:30.301712 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-cf7a18aa-7ea1-45bd-a40c-e7ecbd4246f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:30.302370 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-cf7a18aa-7ea1-45bd-a40c-e7ecbd4246f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:30.308961 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cf7a18aa-7ea1-45bd-a40c-e7ecbd4246f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:30.309476 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cf7a18aa-7ea1-45bd-a40c-e7ecbd4246f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:30.309908 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cf7a18aa-7ea1-45bd-a40c-e7ecbd4246f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:30.310680 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cf7a18aa-7ea1-45bd-a40c-e7ecbd4246f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:30.311148 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cf7a18aa-7ea1-45bd-a40c-e7ecbd4246f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:30.311572 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cf7a18aa-7ea1-45bd-a40c-e7ecbd4246f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:30.432255 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c75b5879-716e-4d29-ba9f-0f87b367a953 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:30.441347 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c75b5879-716e-4d29-ba9f-0f87b367a953 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:30.443063 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c75b5879-716e-4d29-ba9f-0f87b367a953 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:30.443736 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-cf7a18aa-7ea1-45bd-a40c-e7ecbd4246f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:30.444252 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c75b5879-716e-4d29-ba9f-0f87b367a953 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.159374 Aug 08 02:41:30.445025 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 578/1166] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:30 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:30.451830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-cf7a18aa-7ea1-45bd-a40c-e7ecbd4246f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.153894 Aug 08 02:41:30.452391 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 589/1167] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:30 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:31.468439 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0226e8c8-ab43-416a-8a3b-e0d13960ea76 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:31.469055 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0226e8c8-ab43-416a-8a3b-e0d13960ea76 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:31.472544 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2a5e7c16-8ea6-454d-b39a-8117e517ab73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:31.473154 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2a5e7c16-8ea6-454d-b39a-8117e517ab73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:31.475912 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0226e8c8-ab43-416a-8a3b-e0d13960ea76 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:31.476396 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0226e8c8-ab43-416a-8a3b-e0d13960ea76 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:31.477018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0226e8c8-ab43-416a-8a3b-e0d13960ea76 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:31.477724 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0226e8c8-ab43-416a-8a3b-e0d13960ea76 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:31.478196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0226e8c8-ab43-416a-8a3b-e0d13960ea76 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:31.478923 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0226e8c8-ab43-416a-8a3b-e0d13960ea76 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:31.479700 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2a5e7c16-8ea6-454d-b39a-8117e517ab73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:31.480179 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2a5e7c16-8ea6-454d-b39a-8117e517ab73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:31.480669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2a5e7c16-8ea6-454d-b39a-8117e517ab73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:31.481320 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2a5e7c16-8ea6-454d-b39a-8117e517ab73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:31.481764 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2a5e7c16-8ea6-454d-b39a-8117e517ab73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:31.482178 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2a5e7c16-8ea6-454d-b39a-8117e517ab73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:31.611186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0226e8c8-ab43-416a-8a3b-e0d13960ea76 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:31.619709 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2a5e7c16-8ea6-454d-b39a-8117e517ab73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:31.619879 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0226e8c8-ab43-416a-8a3b-e0d13960ea76 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:31.621383 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0226e8c8-ab43-416a-8a3b-e0d13960ea76 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:31.622574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0226e8c8-ab43-416a-8a3b-e0d13960ea76 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.158080 Aug 08 02:41:31.623330 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 579/1168] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:31 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:31.628025 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2a5e7c16-8ea6-454d-b39a-8117e517ab73 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.159157 Aug 08 02:41:31.628602 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 590/1169] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:31 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:41:32.645877 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7259776e-8bc6-403f-ba2f-bf34ea386c9a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:32.646548 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7259776e-8bc6-403f-ba2f-bf34ea386c9a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:32.649169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-845b7d9f-8020-42ad-9e66-cf4064dc6a48 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:32.649783 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-845b7d9f-8020-42ad-9e66-cf4064dc6a48 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:32.653746 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7259776e-8bc6-403f-ba2f-bf34ea386c9a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:32.654240 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7259776e-8bc6-403f-ba2f-bf34ea386c9a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:32.654712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7259776e-8bc6-403f-ba2f-bf34ea386c9a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:32.655432 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7259776e-8bc6-403f-ba2f-bf34ea386c9a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:32.655889 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7259776e-8bc6-403f-ba2f-bf34ea386c9a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:32.656318 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7259776e-8bc6-403f-ba2f-bf34ea386c9a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:32.656543 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-845b7d9f-8020-42ad-9e66-cf4064dc6a48 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:32.657065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-845b7d9f-8020-42ad-9e66-cf4064dc6a48 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:32.657500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-845b7d9f-8020-42ad-9e66-cf4064dc6a48 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:32.658204 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-845b7d9f-8020-42ad-9e66-cf4064dc6a48 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:32.658687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-845b7d9f-8020-42ad-9e66-cf4064dc6a48 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:32.659110 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-845b7d9f-8020-42ad-9e66-cf4064dc6a48 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:32.794773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-845b7d9f-8020-42ad-9e66-cf4064dc6a48 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:32.803427 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7259776e-8bc6-403f-ba2f-bf34ea386c9a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:32.805575 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-845b7d9f-8020-42ad-9e66-cf4064dc6a48 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.161058 Aug 08 02:41:32.806162 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 591/1170] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:32 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:32.818410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7259776e-8bc6-403f-ba2f-bf34ea386c9a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:32.818410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7259776e-8bc6-403f-ba2f-bf34ea386c9a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:32.818410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7259776e-8bc6-403f-ba2f-bf34ea386c9a tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.175154 Aug 08 02:41:32.818856 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 580/1171] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:32 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:41:32.884128 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-a977a047-64e3-47aa-9fd1-580666ca1748 req-b8af8029-64ac-495d-84b3-cc59c367072f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19534a66-fc42-4903-9b95-0dc0cacc67c9", "name": "network-vif-plugged", "status": "completed", "tag": "cc4cfde3-9c47-4a92-a836-463545af627c"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:32.893309 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a977a047-64e3-47aa-9fd1-580666ca1748 req-b8af8029-64ac-495d-84b3-cc59c367072f service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:32.893783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a977a047-64e3-47aa-9fd1-580666ca1748 req-b8af8029-64ac-495d-84b3-cc59c367072f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:32.894237 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a977a047-64e3-47aa-9fd1-580666ca1748 req-b8af8029-64ac-495d-84b3-cc59c367072f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:32.904976 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-a977a047-64e3-47aa-9fd1-580666ca1748 req-b8af8029-64ac-495d-84b3-cc59c367072f service nova] Creating event network-vif-plugged:cc4cfde3-9c47-4a92-a836-463545af627c for instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 on hv-cinder-73306 Aug 08 02:41:32.910425 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-a977a047-64e3-47aa-9fd1-580666ca1748 req-b8af8029-64ac-495d-84b3-cc59c367072f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091312 Aug 08 02:41:32.911016 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 581/1172] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:41:33.827585 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-22a63a91-17d7-40bf-8f8f-8f24afa909ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:33.828188 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-22a63a91-17d7-40bf-8f8f-8f24afa909ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:33.834658 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22a63a91-17d7-40bf-8f8f-8f24afa909ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:33.835131 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22a63a91-17d7-40bf-8f8f-8f24afa909ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:33.835554 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22a63a91-17d7-40bf-8f8f-8f24afa909ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:33.836232 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22a63a91-17d7-40bf-8f8f-8f24afa909ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:33.836673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22a63a91-17d7-40bf-8f8f-8f24afa909ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:33.837092 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-22a63a91-17d7-40bf-8f8f-8f24afa909ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:33.841031 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-461f4bef-d0bf-4257-90ca-998570830c46 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:33.841745 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-461f4bef-d0bf-4257-90ca-998570830c46 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:33.847868 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-461f4bef-d0bf-4257-90ca-998570830c46 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:33.848353 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-461f4bef-d0bf-4257-90ca-998570830c46 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:33.848791 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-461f4bef-d0bf-4257-90ca-998570830c46 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:33.849486 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-461f4bef-d0bf-4257-90ca-998570830c46 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:33.849964 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-461f4bef-d0bf-4257-90ca-998570830c46 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:33.850423 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-461f4bef-d0bf-4257-90ca-998570830c46 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:33.967224 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-22a63a91-17d7-40bf-8f8f-8f24afa909ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:33.974689 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-22a63a91-17d7-40bf-8f8f-8f24afa909ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.150874 Aug 08 02:41:33.975255 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 592/1173] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:33 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:33.980993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-461f4bef-d0bf-4257-90ca-998570830c46 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:33.989480 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-461f4bef-d0bf-4257-90ca-998570830c46 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:33.991004 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-461f4bef-d0bf-4257-90ca-998570830c46 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:33.992148 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-461f4bef-d0bf-4257-90ca-998570830c46 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.155878 Aug 08 02:41:33.992693 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 582/1174] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:33 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:41:34.995376 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7edb6986-b4f3-41d9-b64d-d2da99d5151c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:34.995992 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7edb6986-b4f3-41d9-b64d-d2da99d5151c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:35.002321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7edb6986-b4f3-41d9-b64d-d2da99d5151c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:35.002799 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7edb6986-b4f3-41d9-b64d-d2da99d5151c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:35.003228 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7edb6986-b4f3-41d9-b64d-d2da99d5151c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:35.004436 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7edb6986-b4f3-41d9-b64d-d2da99d5151c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:35.004888 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7edb6986-b4f3-41d9-b64d-d2da99d5151c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:35.005305 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7edb6986-b4f3-41d9-b64d-d2da99d5151c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:35.017551 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8a18ab47-bfdc-493b-875a-2ea9b181a816 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:35.018171 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8a18ab47-bfdc-493b-875a-2ea9b181a816 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:35.025400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a18ab47-bfdc-493b-875a-2ea9b181a816 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:35.025884 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a18ab47-bfdc-493b-875a-2ea9b181a816 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:35.026341 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a18ab47-bfdc-493b-875a-2ea9b181a816 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:35.027053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a18ab47-bfdc-493b-875a-2ea9b181a816 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:35.027496 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a18ab47-bfdc-493b-875a-2ea9b181a816 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:35.027914 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a18ab47-bfdc-493b-875a-2ea9b181a816 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:35.147331 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7edb6986-b4f3-41d9-b64d-d2da99d5151c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:35.154944 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7edb6986-b4f3-41d9-b64d-d2da99d5151c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.163405 Aug 08 02:41:35.155529 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 593/1175] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:34 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:35.194104 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8a18ab47-bfdc-493b-875a-2ea9b181a816 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:35.202684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8a18ab47-bfdc-493b-875a-2ea9b181a816 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:35.204203 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8a18ab47-bfdc-493b-875a-2ea9b181a816 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:35.205377 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8a18ab47-bfdc-493b-875a-2ea9b181a816 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1729 microversion: 2.20 time: 0.194019 Aug 08 02:41:35.205935 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 583/1176] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:35 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:41:36.178019 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b59e6cf0-c682-45df-980b-2ad1360df973 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:36.178657 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b59e6cf0-c682-45df-980b-2ad1360df973 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:36.185183 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b59e6cf0-c682-45df-980b-2ad1360df973 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:36.185662 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b59e6cf0-c682-45df-980b-2ad1360df973 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:36.186096 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b59e6cf0-c682-45df-980b-2ad1360df973 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:36.186811 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b59e6cf0-c682-45df-980b-2ad1360df973 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:36.187263 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b59e6cf0-c682-45df-980b-2ad1360df973 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:36.187686 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b59e6cf0-c682-45df-980b-2ad1360df973 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:36.231527 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5dd3a286-dd2f-4793-9b41-1c413df5d007 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:36.233154 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5dd3a286-dd2f-4793-9b41-1c413df5d007 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:36.241075 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5dd3a286-dd2f-4793-9b41-1c413df5d007 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:36.241559 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5dd3a286-dd2f-4793-9b41-1c413df5d007 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:36.241996 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5dd3a286-dd2f-4793-9b41-1c413df5d007 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:36.242758 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5dd3a286-dd2f-4793-9b41-1c413df5d007 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:36.243209 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5dd3a286-dd2f-4793-9b41-1c413df5d007 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:36.243640 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5dd3a286-dd2f-4793-9b41-1c413df5d007 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:36.321296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b59e6cf0-c682-45df-980b-2ad1360df973 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:36.329057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b59e6cf0-c682-45df-980b-2ad1360df973 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.154869 Aug 08 02:41:36.329624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 594/1177] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:36 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:36.373647 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5dd3a286-dd2f-4793-9b41-1c413df5d007 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:36.381547 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5dd3a286-dd2f-4793-9b41-1c413df5d007 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:36.383101 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5dd3a286-dd2f-4793-9b41-1c413df5d007 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:36.384469 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5dd3a286-dd2f-4793-9b41-1c413df5d007 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1716 microversion: 2.20 time: 0.156961 Aug 08 02:41:36.385034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 584/1178] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:41:36 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 02:41:37.351148 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1e3d311a-0f1a-4e76-aca4-615b3dc34d2b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:37.351821 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1e3d311a-0f1a-4e76-aca4-615b3dc34d2b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:37.357959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e3d311a-0f1a-4e76-aca4-615b3dc34d2b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:37.358468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e3d311a-0f1a-4e76-aca4-615b3dc34d2b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:37.358899 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e3d311a-0f1a-4e76-aca4-615b3dc34d2b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:37.359578 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e3d311a-0f1a-4e76-aca4-615b3dc34d2b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:37.360028 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e3d311a-0f1a-4e76-aca4-615b3dc34d2b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:37.360450 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1e3d311a-0f1a-4e76-aca4-615b3dc34d2b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:37.498563 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1e3d311a-0f1a-4e76-aca4-615b3dc34d2b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:37.506037 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1e3d311a-0f1a-4e76-aca4-615b3dc34d2b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.159249 Aug 08 02:41:37.506635 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 595/1179] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:37 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:38.527214 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-74a879a6-0305-4849-8845-ebd355dd25ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:38.527821 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-74a879a6-0305-4849-8845-ebd355dd25ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:38.534276 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74a879a6-0305-4849-8845-ebd355dd25ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:38.534749 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74a879a6-0305-4849-8845-ebd355dd25ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:38.535732 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74a879a6-0305-4849-8845-ebd355dd25ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:38.536406 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74a879a6-0305-4849-8845-ebd355dd25ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:38.536853 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74a879a6-0305-4849-8845-ebd355dd25ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:38.537268 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74a879a6-0305-4849-8845-ebd355dd25ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:38.663661 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-74a879a6-0305-4849-8845-ebd355dd25ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:38.671028 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-74a879a6-0305-4849-8845-ebd355dd25ac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.148604 Aug 08 02:41:38.671591 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 585/1180] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:38 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:39.691778 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d9af3c20-98dc-4730-972e-6da4dd6e247f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:39.692383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d9af3c20-98dc-4730-972e-6da4dd6e247f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:39.694696 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:39.700065 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d9af3c20-98dc-4730-972e-6da4dd6e247f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:39.700477 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d9af3c20-98dc-4730-972e-6da4dd6e247f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:39.700900 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d9af3c20-98dc-4730-972e-6da4dd6e247f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:39.701614 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d9af3c20-98dc-4730-972e-6da4dd6e247f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:39.702057 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d9af3c20-98dc-4730-972e-6da4dd6e247f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:39.702498 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d9af3c20-98dc-4730-972e-6da4dd6e247f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:39.837961 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d9af3c20-98dc-4730-972e-6da4dd6e247f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:39.845447 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d9af3c20-98dc-4730-972e-6da4dd6e247f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.157751 Aug 08 02:41:39.846017 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 596/1181] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:39 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:40.866984 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cf5ebad7-4fee-4ac1-bfac-916d09be658a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:40.867603 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cf5ebad7-4fee-4ac1-bfac-916d09be658a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:40.873988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf5ebad7-4fee-4ac1-bfac-916d09be658a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:40.874499 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf5ebad7-4fee-4ac1-bfac-916d09be658a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:40.874936 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf5ebad7-4fee-4ac1-bfac-916d09be658a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:40.875681 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf5ebad7-4fee-4ac1-bfac-916d09be658a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:40.876170 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf5ebad7-4fee-4ac1-bfac-916d09be658a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:40.876602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf5ebad7-4fee-4ac1-bfac-916d09be658a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:41.010364 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cf5ebad7-4fee-4ac1-bfac-916d09be658a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:41.017679 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cf5ebad7-4fee-4ac1-bfac-916d09be658a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.155076 Aug 08 02:41:41.018241 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 586/1182] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:40 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:42.038025 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5cfd8df3-07cd-4c81-b493-91970d5e9896 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:42.038668 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5cfd8df3-07cd-4c81-b493-91970d5e9896 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:42.045206 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5cfd8df3-07cd-4c81-b493-91970d5e9896 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:42.045683 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5cfd8df3-07cd-4c81-b493-91970d5e9896 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:42.046117 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5cfd8df3-07cd-4c81-b493-91970d5e9896 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:42.046843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5cfd8df3-07cd-4c81-b493-91970d5e9896 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:42.047293 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5cfd8df3-07cd-4c81-b493-91970d5e9896 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:42.047713 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5cfd8df3-07cd-4c81-b493-91970d5e9896 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:42.180904 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5cfd8df3-07cd-4c81-b493-91970d5e9896 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:42.188257 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5cfd8df3-07cd-4c81-b493-91970d5e9896 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.154096 Aug 08 02:41:42.188815 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 597/1183] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:42 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:42.670780 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-5724c52a-6f00-4a6e-92f1-ba74b90f6ff2 req-011d3e63-4d4d-4fae-921c-21cd42b159c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800f1d48-496a-4d2b-93b3-f9d65ae6e824", "name": "network-vif-plugged", "status": "completed", "tag": "a0d07287-712e-4449-a18d-cf15f3307426"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:42.676482 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:41:42.684195 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-5724c52a-6f00-4a6e-92f1-ba74b90f6ff2 req-011d3e63-4d4d-4fae-921c-21cd42b159c2 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:42.684672 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-5724c52a-6f00-4a6e-92f1-ba74b90f6ff2 req-011d3e63-4d4d-4fae-921c-21cd42b159c2 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:42.685102 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-5724c52a-6f00-4a6e-92f1-ba74b90f6ff2 req-011d3e63-4d4d-4fae-921c-21cd42b159c2 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:42.697553 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-5724c52a-6f00-4a6e-92f1-ba74b90f6ff2 req-011d3e63-4d4d-4fae-921c-21cd42b159c2 service nova] Creating event network-vif-plugged:a0d07287-712e-4449-a18d-cf15f3307426 for instance 800f1d48-496a-4d2b-93b3-f9d65ae6e824 on hv-cinder-73306 Aug 08 02:41:42.702405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-5724c52a-6f00-4a6e-92f1-ba74b90f6ff2 req-011d3e63-4d4d-4fae-921c-21cd42b159c2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035256 Aug 08 02:41:42.703187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 587/1184] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:41:43.210195 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5ae571a9-0a6c-45f3-9eae-48ec9d9eecba tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:43.210753 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5ae571a9-0a6c-45f3-9eae-48ec9d9eecba tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:43.217080 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5ae571a9-0a6c-45f3-9eae-48ec9d9eecba tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:43.217576 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5ae571a9-0a6c-45f3-9eae-48ec9d9eecba tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:43.218002 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5ae571a9-0a6c-45f3-9eae-48ec9d9eecba tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:43.218714 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5ae571a9-0a6c-45f3-9eae-48ec9d9eecba tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:43.219156 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5ae571a9-0a6c-45f3-9eae-48ec9d9eecba tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:43.219574 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5ae571a9-0a6c-45f3-9eae-48ec9d9eecba tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:43.350572 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5ae571a9-0a6c-45f3-9eae-48ec9d9eecba tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:43.357962 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5ae571a9-0a6c-45f3-9eae-48ec9d9eecba tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.152288 Aug 08 02:41:43.358570 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 598/1185] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:43 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:44.380432 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3edc4c54-c55f-409b-ace4-c33742610991 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:44.381143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3edc4c54-c55f-409b-ace4-c33742610991 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:44.387328 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3edc4c54-c55f-409b-ace4-c33742610991 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:44.387768 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3edc4c54-c55f-409b-ace4-c33742610991 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:44.388384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3edc4c54-c55f-409b-ace4-c33742610991 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:44.389309 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3edc4c54-c55f-409b-ace4-c33742610991 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:44.389760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3edc4c54-c55f-409b-ace4-c33742610991 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:44.390200 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3edc4c54-c55f-409b-ace4-c33742610991 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:44.524053 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3edc4c54-c55f-409b-ace4-c33742610991 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:44.531433 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3edc4c54-c55f-409b-ace4-c33742610991 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1265 microversion: 2.1 time: 0.156873 Aug 08 02:41:44.531997 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 588/1186] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:44 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:45.551640 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e29bbdc3-f228-4371-ab29-5bf27ff4ff84 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:45.552252 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e29bbdc3-f228-4371-ab29-5bf27ff4ff84 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:45.558845 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e29bbdc3-f228-4371-ab29-5bf27ff4ff84 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:45.559322 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e29bbdc3-f228-4371-ab29-5bf27ff4ff84 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:45.559753 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e29bbdc3-f228-4371-ab29-5bf27ff4ff84 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:45.560442 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e29bbdc3-f228-4371-ab29-5bf27ff4ff84 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:45.561246 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e29bbdc3-f228-4371-ab29-5bf27ff4ff84 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:45.561372 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e29bbdc3-f228-4371-ab29-5bf27ff4ff84 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:45.689584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e29bbdc3-f228-4371-ab29-5bf27ff4ff84 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:45.697673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e29bbdc3-f228-4371-ab29-5bf27ff4ff84 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1451 microversion: 2.1 time: 0.149884 Aug 08 02:41:45.698306 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 599/1187] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:45 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:45.717751 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6f2b1b5c-5a53-41f4-b9db-a85ea6a871e2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:41:45.718384 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6f2b1b5c-5a53-41f4-b9db-a85ea6a871e2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:41:45.724678 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f2b1b5c-5a53-41f4-b9db-a85ea6a871e2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:45.725151 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f2b1b5c-5a53-41f4-b9db-a85ea6a871e2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:45.725576 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f2b1b5c-5a53-41f4-b9db-a85ea6a871e2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:45.726270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f2b1b5c-5a53-41f4-b9db-a85ea6a871e2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:45.726718 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f2b1b5c-5a53-41f4-b9db-a85ea6a871e2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:45.727131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f2b1b5c-5a53-41f4-b9db-a85ea6a871e2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:45.856790 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6f2b1b5c-5a53-41f4-b9db-a85ea6a871e2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:41:45.864808 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6f2b1b5c-5a53-41f4-b9db-a85ea6a871e2 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1451 microversion: 2.1 time: 0.150944 Aug 08 02:41:45.865390 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 589/1188] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:41:45 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:41:47.470814 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-a044580c-d0b8-4a93-be08-0e39c817511e req-da1bd36a-432b-4303-a0b4-9092043c339a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800f1d48-496a-4d2b-93b3-f9d65ae6e824", "tag": "a0d07287-712e-4449-a18d-cf15f3307426"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:41:47.480321 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-a044580c-d0b8-4a93-be08-0e39c817511e req-da1bd36a-432b-4303-a0b4-9092043c339a service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:41:47.480795 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-a044580c-d0b8-4a93-be08-0e39c817511e req-da1bd36a-432b-4303-a0b4-9092043c339a service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:41:47.481222 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-a044580c-d0b8-4a93-be08-0e39c817511e req-da1bd36a-432b-4303-a0b4-9092043c339a service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:41:47.492990 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-a044580c-d0b8-4a93-be08-0e39c817511e req-da1bd36a-432b-4303-a0b4-9092043c339a service nova] Creating event network-changed:a0d07287-712e-4449-a18d-cf15f3307426 for instance 800f1d48-496a-4d2b-93b3-f9d65ae6e824 on hv-cinder-73306 Aug 08 02:41:47.498082 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-a044580c-d0b8-4a93-be08-0e39c817511e req-da1bd36a-432b-4303-a0b4-9092043c339a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094539 Aug 08 02:41:47.498662 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 600/1189] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:42:15.996916 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:42:15.997418 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Mon Aug 8 02:42:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:42:16.925178 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:42:16.925745 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Mon Aug 8 02:42:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:42:43.523056 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bed2e24c-514d-4447-8b10-a27e92d57f99 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:43.525297 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bed2e24c-514d-4447-8b10-a27e92d57f99 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:43.527349 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=5 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:43.528010 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=95 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:43.533542 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bed2e24c-514d-4447-8b10-a27e92d57f99 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:43.534678 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bed2e24c-514d-4447-8b10-a27e92d57f99 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:43.535119 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bed2e24c-514d-4447-8b10-a27e92d57f99 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:43.535809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bed2e24c-514d-4447-8b10-a27e92d57f99 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:43.536261 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bed2e24c-514d-4447-8b10-a27e92d57f99 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:43.536684 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bed2e24c-514d-4447-8b10-a27e92d57f99 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:43.564893 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bed2e24c-514d-4447-8b10-a27e92d57f99 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046559 Aug 08 02:42:43.565712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 590/1190] 10.222.0.39 () {60 vars in 1343 bytes} [Mon Aug 8 02:42:43 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:42:43.624677 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=9 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:43.625403 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=93 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:42:43.630005 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-0bbd4910-1f2e-49bf-a210-9db71e2a2238 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:43.630590 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0bbd4910-1f2e-49bf-a210-9db71e2a2238 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:43.637400 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0bbd4910-1f2e-49bf-a210-9db71e2a2238 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:43.637869 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0bbd4910-1f2e-49bf-a210-9db71e2a2238 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:43.638317 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0bbd4910-1f2e-49bf-a210-9db71e2a2238 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:43.638994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0bbd4910-1f2e-49bf-a210-9db71e2a2238 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:43.639438 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0bbd4910-1f2e-49bf-a210-9db71e2a2238 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:43.639852 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-0bbd4910-1f2e-49bf-a210-9db71e2a2238 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:43.664956 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-0bbd4910-1f2e-49bf-a210-9db71e2a2238 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:42:43.739802 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-0bbd4910-1f2e-49bf-a210-9db71e2a2238 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "DELETE /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 204 len: 0 microversion: 2.20 time: 0.116565 Aug 08 02:42:43.740314 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 601/1191] 10.222.0.39 () {60 vars in 1280 bytes} [Mon Aug 8 02:42:43 2022] DELETE /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 02:42:43.749839 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-250b8f97-0f96-41e4-b5fa-c337d16d6045 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:43.750922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-250b8f97-0f96-41e4-b5fa-c337d16d6045 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:43.757212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-250b8f97-0f96-41e4-b5fa-c337d16d6045 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:43.757699 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-250b8f97-0f96-41e4-b5fa-c337d16d6045 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:43.758127 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-250b8f97-0f96-41e4-b5fa-c337d16d6045 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:43.758854 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-250b8f97-0f96-41e4-b5fa-c337d16d6045 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:43.759296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-250b8f97-0f96-41e4-b5fa-c337d16d6045 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:43.759709 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-250b8f97-0f96-41e4-b5fa-c337d16d6045 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:43.889156 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-250b8f97-0f96-41e4-b5fa-c337d16d6045 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:43.897630 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-250b8f97-0f96-41e4-b5fa-c337d16d6045 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:43.899154 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-250b8f97-0f96-41e4-b5fa-c337d16d6045 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:43.900298 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-250b8f97-0f96-41e4-b5fa-c337d16d6045 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.155736 Aug 08 02:42:43.900850 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 591/1192] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:43 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:44.924079 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-78bd8725-bf4d-434c-a2e9-935e9c045817 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:44.925432 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-78bd8725-bf4d-434c-a2e9-935e9c045817 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:44.931748 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-78bd8725-bf4d-434c-a2e9-935e9c045817 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:44.932225 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-78bd8725-bf4d-434c-a2e9-935e9c045817 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:44.932656 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-78bd8725-bf4d-434c-a2e9-935e9c045817 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:44.933341 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-78bd8725-bf4d-434c-a2e9-935e9c045817 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:44.933788 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-78bd8725-bf4d-434c-a2e9-935e9c045817 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:44.934210 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-78bd8725-bf4d-434c-a2e9-935e9c045817 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:45.094721 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-78bd8725-bf4d-434c-a2e9-935e9c045817 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:45.103400 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-78bd8725-bf4d-434c-a2e9-935e9c045817 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:45.104892 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-78bd8725-bf4d-434c-a2e9-935e9c045817 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:45.106068 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-78bd8725-bf4d-434c-a2e9-935e9c045817 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.186355 Aug 08 02:42:45.106671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 602/1193] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:44 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:46.129862 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3a94e598-ac4c-41f8-b7e4-282f82c56c42 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:46.130556 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3a94e598-ac4c-41f8-b7e4-282f82c56c42 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:46.137317 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a94e598-ac4c-41f8-b7e4-282f82c56c42 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:46.137806 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a94e598-ac4c-41f8-b7e4-282f82c56c42 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:46.138370 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a94e598-ac4c-41f8-b7e4-282f82c56c42 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:46.139073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a94e598-ac4c-41f8-b7e4-282f82c56c42 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:46.139519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a94e598-ac4c-41f8-b7e4-282f82c56c42 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:46.140000 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a94e598-ac4c-41f8-b7e4-282f82c56c42 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:46.273298 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a94e598-ac4c-41f8-b7e4-282f82c56c42 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:46.281577 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a94e598-ac4c-41f8-b7e4-282f82c56c42 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:46.283110 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a94e598-ac4c-41f8-b7e4-282f82c56c42 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:46.284803 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3a94e598-ac4c-41f8-b7e4-282f82c56c42 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1722 microversion: 2.20 time: 0.159787 Aug 08 02:42:46.285412 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 592/1194] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:46 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:46.673889 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-8aecc920-26ed-4015-986b-da547ea54c2e req-3c03bfd2-88ba-48f3-beca-67795d8c8c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19534a66-fc42-4903-9b95-0dc0cacc67c9", "name": "network-vif-deleted", "tag": "cc4cfde3-9c47-4a92-a836-463545af627c"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:42:46.691735 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-8aecc920-26ed-4015-986b-da547ea54c2e req-3c03bfd2-88ba-48f3-beca-67795d8c8c77 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:46.692218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-8aecc920-26ed-4015-986b-da547ea54c2e req-3c03bfd2-88ba-48f3-beca-67795d8c8c77 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:46.692663 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-8aecc920-26ed-4015-986b-da547ea54c2e req-3c03bfd2-88ba-48f3-beca-67795d8c8c77 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:46.710032 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-8aecc920-26ed-4015-986b-da547ea54c2e req-3c03bfd2-88ba-48f3-beca-67795d8c8c77 service nova] Creating event network-vif-deleted:cc4cfde3-9c47-4a92-a836-463545af627c for instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 on hv-cinder-73306 Aug 08 02:42:46.718735 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-8aecc920-26ed-4015-986b-da547ea54c2e req-3c03bfd2-88ba-48f3-beca-67795d8c8c77 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109559 Aug 08 02:42:46.719741 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 603/1195] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:42:47.309207 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:47.309836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:47.317867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:47.318430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:47.318865 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:47.319754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:47.320134 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:47.320764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:47.355647 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:47.356247 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:47.356554 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:47.357000 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lazy-loading 'fault' on Instance uuid 19534a66-fc42-4903-9b95-0dc0cacc67c9 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:42:47.405947 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:47.414570 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:47.416375 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5de4e28bfee14bae93c7f7a8f3f098fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcedd52439b47689047813e0566ba78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:42:47.417777 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0ae28fe6-88fe-42fc-b2aa-49d8fc8c6275 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 200 len: 1371 microversion: 2.20 time: 0.112658 Aug 08 02:42:47.430575 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 593/1196] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:47 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 1371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 02:42:48.443902 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ec89eec5-e5b9-4cb0-9386-96bfc1320f47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:48.444606 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ec89eec5-e5b9-4cb0-9386-96bfc1320f47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:48.451259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec89eec5-e5b9-4cb0-9386-96bfc1320f47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:48.452010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec89eec5-e5b9-4cb0-9386-96bfc1320f47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:48.452453 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec89eec5-e5b9-4cb0-9386-96bfc1320f47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:48.453142 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec89eec5-e5b9-4cb0-9386-96bfc1320f47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:48.453593 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec89eec5-e5b9-4cb0-9386-96bfc1320f47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:48.454016 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ec89eec5-e5b9-4cb0-9386-96bfc1320f47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:48.467872 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-ec89eec5-e5b9-4cb0-9386-96bfc1320f47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] HTTP exception thrown: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ec89eec5-e5b9-4cb0-9386-96bfc1320f47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Request method failure captured: Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 HTTP/1.1 Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HYZSqCNJUwodo8x4ayVQzaNbr3dbFbbQhR5RnZ3Pkw73cLxha0rRoLbMBLakdXrkVrmz2ZQPKvxdYgR_CG1LiiyD-1FZAGi7LN2t1_HPQDmM0k4VthQL103eETgFqdFFUf6tsoSuH5vWaUysozCoJV6ENmJtYLM9td6KdqMzsr2VhU Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 6dcedd52439b47689047813e0566ba78 Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:42:48.469481 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:42:48.471218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6dcedd52439b47689047813e0566ba78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dcedd52439b47689047813e0566ba78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6dcedd52439b47689047813e0566ba78", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dcedd52439b47689047813e0566ba78"}]}] Aug 08 02:42:48.471218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:48.471218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 6dcedd52439b47689047813e0566ba78 Aug 08 02:42:48.471218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:48.471218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeShelveTestJSON-1491463072-project Aug 08 02:42:48.471218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:42:48.471218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:42:48.471218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 5de4e28bfee14bae93c7f7a8f3f098fc Aug 08 02:42:48.471218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1491463072-project Aug 08 02:42:48.471218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:42:48.471218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:48.471218 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '19534a66-fc42-4903-9b95-0dc0cacc67c9'} Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:42:48.472250 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:48.473832 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:48.475561 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ec89eec5-e5b9-4cb0-9386-96bfc1320f47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Returning 404 to user: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:42:48.475561 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ec89eec5-e5b9-4cb0-9386-96bfc1320f47 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 404 len: 111 microversion: 2.20 time: 0.032052 Aug 08 02:42:48.475561 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 604/1197] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:48 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:42:48.479686 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1badc792-0161-49c1-80f8-53b5511b9cef tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '.version_select at 0x7f3295c7f160>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:48.500934 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1badc792-0161-49c1-80f8-53b5511b9cef tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538353045" status: 204 len: 0 microversion: 2.20 time: 0.025028 Aug 08 02:42:48.501489 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 594/1198] 10.222.0.39 () {60 vars in 1262 bytes} [Mon Aug 8 02:42:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538353045 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 02:42:50.232565 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fa8b958d-d3af-4a44-8847-79984af0346f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:50.233040 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-fa8b958d-d3af-4a44-8847-79984af0346f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:50.239382 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fa8b958d-d3af-4a44-8847-79984af0346f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:50.239859 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fa8b958d-d3af-4a44-8847-79984af0346f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:50.240274 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fa8b958d-d3af-4a44-8847-79984af0346f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:50.241368 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fa8b958d-d3af-4a44-8847-79984af0346f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:50.241914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fa8b958d-d3af-4a44-8847-79984af0346f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:50.242602 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-fa8b958d-d3af-4a44-8847-79984af0346f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:50.256831 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-fa8b958d-d3af-4a44-8847-79984af0346f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] HTTP exception thrown: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fa8b958d-d3af-4a44-8847-79984af0346f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Request method failure captured: Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: DELETE /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 HTTP/1.1 Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HYZSqCNJUwodo8x4ayVQzaNbr3dbFbbQhR5RnZ3Pkw73cLxha0rRoLbMBLakdXrkVrmz2ZQPKvxdYgR_CG1LiiyD-1FZAGi7LN2t1_HPQDmM0k4VthQL103eETgFqdFFUf6tsoSuH5vWaUysozCoJV6ENmJtYLM9td6KdqMzsr2VhU Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 6dcedd52439b47689047813e0566ba78 Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:42:50.258383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:42:50.260090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6dcedd52439b47689047813e0566ba78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dcedd52439b47689047813e0566ba78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6dcedd52439b47689047813e0566ba78", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dcedd52439b47689047813e0566ba78"}]}] Aug 08 02:42:50.260090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:50.260090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 6dcedd52439b47689047813e0566ba78 Aug 08 02:42:50.260090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:50.260090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeShelveTestJSON-1491463072-project Aug 08 02:42:50.260090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:42:50.260090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:42:50.260090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 5de4e28bfee14bae93c7f7a8f3f098fc Aug 08 02:42:50.260090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1491463072-project Aug 08 02:42:50.260090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:42:50.260090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:50.260090 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '19534a66-fc42-4903-9b95-0dc0cacc67c9'} Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:42:50.260959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:50.262478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:50.263923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fa8b958d-d3af-4a44-8847-79984af0346f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Returning 404 to user: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:42:50.263923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fa8b958d-d3af-4a44-8847-79984af0346f tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "DELETE /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 404 len: 111 microversion: 2.20 time: 0.031015 Aug 08 02:42:50.263923 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 605/1199] 10.222.0.39 () {60 vars in 1280 bytes} [Mon Aug 8 02:42:50 2022] DELETE /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:42:50.269405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dbe3d384-4a42-47db-a1a8-41258e677e93 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:50.270043 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dbe3d384-4a42-47db-a1a8-41258e677e93 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 19534a66-fc42-4903-9b95-0dc0cacc67c9] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:50.276443 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbe3d384-4a42-47db-a1a8-41258e677e93 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:50.276922 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbe3d384-4a42-47db-a1a8-41258e677e93 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:50.277470 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbe3d384-4a42-47db-a1a8-41258e677e93 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:50.278027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbe3d384-4a42-47db-a1a8-41258e677e93 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:50.278505 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbe3d384-4a42-47db-a1a8-41258e677e93 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:50.278925 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dbe3d384-4a42-47db-a1a8-41258e677e93 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:50.292170 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-dbe3d384-4a42-47db-a1a8-41258e677e93 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] HTTP exception thrown: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dbe3d384-4a42-47db-a1a8-41258e677e93 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Request method failure captured: Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 HTTP/1.1 Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HYZSqCNJUwodo8x4ayVQzaNbr3dbFbbQhR5RnZ3Pkw73cLxha0rRoLbMBLakdXrkVrmz2ZQPKvxdYgR_CG1LiiyD-1FZAGi7LN2t1_HPQDmM0k4VthQL103eETgFqdFFUf6tsoSuH5vWaUysozCoJV6ENmJtYLM9td6KdqMzsr2VhU Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 6dcedd52439b47689047813e0566ba78 Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:42:50.293801 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:42:50.295531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6dcedd52439b47689047813e0566ba78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dcedd52439b47689047813e0566ba78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6dcedd52439b47689047813e0566ba78", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dcedd52439b47689047813e0566ba78"}]}] Aug 08 02:42:50.295531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:50.295531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 6dcedd52439b47689047813e0566ba78 Aug 08 02:42:50.295531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:50.295531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeShelveTestJSON-1491463072-project Aug 08 02:42:50.295531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:42:50.295531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:42:50.295531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 5de4e28bfee14bae93c7f7a8f3f098fc Aug 08 02:42:50.295531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1491463072-project Aug 08 02:42:50.295531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:42:50.295531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:50.295531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '19534a66-fc42-4903-9b95-0dc0cacc67c9'} Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:42:50.296466 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. Aug 08 02:42:50.298019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:42:50.299961 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dbe3d384-4a42-47db-a1a8-41258e677e93 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Returning 404 to user: Instance 19534a66-fc42-4903-9b95-0dc0cacc67c9 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:42:50.299961 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dbe3d384-4a42-47db-a1a8-41258e677e93 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9" status: 404 len: 111 microversion: 2.20 time: 0.030815 Aug 08 02:42:50.299961 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 595/1200] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:50 2022] GET /compute/v2.1/servers/19534a66-fc42-4903-9b95-0dc0cacc67c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:42:51.430652 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f59b5b56-9c12-4004-a00a-a50cf310d257 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:51.431200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-f59b5b56-9c12-4004-a00a-a50cf310d257 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:51.437547 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f59b5b56-9c12-4004-a00a-a50cf310d257 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:51.438001 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f59b5b56-9c12-4004-a00a-a50cf310d257 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:51.438462 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f59b5b56-9c12-4004-a00a-a50cf310d257 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:51.439141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f59b5b56-9c12-4004-a00a-a50cf310d257 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:51.439599 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f59b5b56-9c12-4004-a00a-a50cf310d257 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:51.440896 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-f59b5b56-9c12-4004-a00a-a50cf310d257 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:51.456915 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-f59b5b56-9c12-4004-a00a-a50cf310d257 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] HTTP exception thrown: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f59b5b56-9c12-4004-a00a-a50cf310d257 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Request method failure captured: Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: DELETE /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be HTTP/1.1 Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HYZSqCNJUwodo8x4ayVQzaNbr3dbFbbQhR5RnZ3Pkw73cLxha0rRoLbMBLakdXrkVrmz2ZQPKvxdYgR_CG1LiiyD-1FZAGi7LN2t1_HPQDmM0k4VthQL103eETgFqdFFUf6tsoSuH5vWaUysozCoJV6ENmJtYLM9td6KdqMzsr2VhU Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 6dcedd52439b47689047813e0566ba78 Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:42:51.458483 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:42:51.460165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6dcedd52439b47689047813e0566ba78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dcedd52439b47689047813e0566ba78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6dcedd52439b47689047813e0566ba78", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dcedd52439b47689047813e0566ba78"}]}] Aug 08 02:42:51.460165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:51.460165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 6dcedd52439b47689047813e0566ba78 Aug 08 02:42:51.460165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:51.460165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-AttachVolumeShelveTestJSON-1491463072-project Aug 08 02:42:51.460165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:42:51.460165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:42:51.460165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 5de4e28bfee14bae93c7f7a8f3f098fc Aug 08 02:42:51.460165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1491463072-project Aug 08 02:42:51.460165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:42:51.460165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:42:51.460165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '614b1928-9870-453b-8bf7-7b21f36ed2be'} Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:42:51.461212 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:42:51.462771 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:42:51.464690 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-f59b5b56-9c12-4004-a00a-a50cf310d257 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Returning 404 to user: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:42:51.464690 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-f59b5b56-9c12-4004-a00a-a50cf310d257 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "DELETE /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 404 len: 111 microversion: 2.20 time: 0.033114 Aug 08 02:42:51.464690 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 606/1201] 10.222.0.39 () {60 vars in 1280 bytes} [Mon Aug 8 02:42:51 2022] DELETE /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:42:51.468299 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-51dfcc0b-6c3b-4b74-8c66-304cc362cac4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:51.468920 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-51dfcc0b-6c3b-4b74-8c66-304cc362cac4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] [instance: 614b1928-9870-453b-8bf7-7b21f36ed2be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:42:51.475402 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51dfcc0b-6c3b-4b74-8c66-304cc362cac4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:51.475885 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51dfcc0b-6c3b-4b74-8c66-304cc362cac4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:51.476325 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51dfcc0b-6c3b-4b74-8c66-304cc362cac4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:51.477013 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51dfcc0b-6c3b-4b74-8c66-304cc362cac4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:42:51.477464 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51dfcc0b-6c3b-4b74-8c66-304cc362cac4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:42:51.477933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-51dfcc0b-6c3b-4b74-8c66-304cc362cac4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:42:51.491070 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-51dfcc0b-6c3b-4b74-8c66-304cc362cac4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] HTTP exception thrown: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-51dfcc0b-6c3b-4b74-8c66-304cc362cac4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Request method failure captured: Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be HTTP/1.1 Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HYZSqCNJUwodo8x4ayVQzaNbr3dbFbbQhR5RnZ3Pkw73cLxha0rRoLbMBLakdXrkVrmz2ZQPKvxdYgR_CG1LiiyD-1FZAGi7LN2t1_HPQDmM0k4VthQL103eETgFqdFFUf6tsoSuH5vWaUysozCoJV6ENmJtYLM9td6KdqMzsr2VhU Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 6dcedd52439b47689047813e0566ba78 Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:42:51.492614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:42:51.494270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6dcedd52439b47689047813e0566ba78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dcedd52439b47689047813e0566ba78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6dcedd52439b47689047813e0566ba78", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dcedd52439b47689047813e0566ba78"}]}] Aug 08 02:42:51.494270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:51.494270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 6dcedd52439b47689047813e0566ba78 Aug 08 02:42:51.494270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1491463072 Aug 08 02:42:51.494270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeShelveTestJSON-1491463072-project Aug 08 02:42:51.494270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:42:51.494270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:42:51.494270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 5de4e28bfee14bae93c7f7a8f3f098fc Aug 08 02:42:51.494270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1491463072-project Aug 08 02:42:51.494270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:42:51.494270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:42:51.494270 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '614b1928-9870-453b-8bf7-7b21f36ed2be'} Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:42:51.495169 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. Aug 08 02:42:51.496532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:42:51.497683 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-51dfcc0b-6c3b-4b74-8c66-304cc362cac4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] Returning 404 to user: Instance 614b1928-9870-453b-8bf7-7b21f36ed2be could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:42:51.497683 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-51dfcc0b-6c3b-4b74-8c66-304cc362cac4 tempest-AttachVolumeShelveTestJSON-1491463072 tempest-AttachVolumeShelveTestJSON-1491463072-project] 10.222.0.39 "GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be" status: 404 len: 111 microversion: 2.20 time: 0.029565 Aug 08 02:42:51.497683 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 596/1202] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Aug 8 02:42:51 2022] GET /compute/v2.1/servers/614b1928-9870-453b-8bf7-7b21f36ed2be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 02:42:57.137963 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a2f8d20d-d6b3-4534-b8b7-ffe6b9c28d34 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] Calling method '.version_select at 0x7f32952770d0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:57.185104 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a2f8d20d-d6b3-4534-b8b7-ffe6b9c28d34 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/d3104f02-e2ca-42d1-bf0d-4449c5ca1771" status: 200 len: 350 microversion: 2.1 time: 0.050875 Aug 08 02:42:57.185671 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 607/1203] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:42:57 2022] GET /compute/v2.1/os-volumes/d3104f02-e2ca-42d1-bf0d-4449c5ca1771 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:42:58.522984 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1b0c67e4-eb30-47b7-8460-823dac944dc4 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] Calling method '.version_select at 0x7f3295c9f700>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:58.569809 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1b0c67e4-eb30-47b7-8460-823dac944dc4 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/cd8d046d-85f3-476b-835f-f33a5c1d6df0" status: 200 len: 351 microversion: 2.1 time: 0.050543 Aug 08 02:42:58.570401 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 597/1204] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:42:58 2022] GET /compute/v2.1/os-volumes/cd8d046d-85f3-476b-835f-f33a5c1d6df0 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:42:59.892458 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-11dd6dfc-e8f6-4b99-b4b6-ca3df6f22662 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] Calling method '.version_select at 0x7f329501f1f0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:42:59.937551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-11dd6dfc-e8f6-4b99-b4b6-ca3df6f22662 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/49aa8d96-e4fe-4b2d-9108-3af770629e54" status: 200 len: 350 microversion: 2.1 time: 0.049300 Aug 08 02:42:59.938105 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 608/1205] 10.222.0.39 () {58 vars in 1245 bytes} [Mon Aug 8 02:42:59 2022] GET /compute/v2.1/os-volumes/49aa8d96-e4fe-4b2d-9108-3af770629e54 => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:42:59.951271 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8fbb76c7-8711-4409-bcd7-00057467d92d tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] Calling method '.version_select at 0x7f329584c1f0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:00.031187 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8fbb76c7-8711-4409-bcd7-00057467d92d tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.083954 Aug 08 02:43:00.031754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 598/1206] 10.222.0.39 () {58 vars in 1134 bytes} [Mon Aug 8 02:42:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:43:00.045135 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-572eab54-f609-4b50-ab76-fd18304acf53 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] Calling method '.version_select at 0x7f329537da60>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:00.126026 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-572eab54-f609-4b50-ab76-fd18304acf53 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084638 Aug 08 02:43:00.126618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 609/1207] 10.222.0.39 () {58 vars in 1149 bytes} [Mon Aug 8 02:43:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:43:00.140296 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-31f358c1-10fb-4aaf-9065-036157ae9339 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] Calling method '.version_select at 0x7f329584c160>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:00.219388 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-31f358c1-10fb-4aaf-9065-036157ae9339 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082715 Aug 08 02:43:00.219948 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 599/1208] 10.222.0.39 () {58 vars in 1134 bytes} [Mon Aug 8 02:43:00 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:43:00.232478 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a4a259c2-ed7a-4025-90f4-e9e322767fd1 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] Calling method '.version_select at 0x7f3295520e50>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:00.313428 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a4a259c2-ed7a-4025-90f4-e9e322767fd1 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084607 Aug 08 02:43:00.314025 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 610/1209] 10.222.0.39 () {58 vars in 1167 bytes} [Mon Aug 8 02:43:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:43:00.327851 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a7a03ca3-c2d3-4a44-86d3-d1323403f983 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] Calling method '.version_select at 0x7f32958c2040>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:00.406854 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a7a03ca3-c2d3-4a44-86d3-d1323403f983 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082603 Aug 08 02:43:00.407428 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 600/1210] 10.222.0.39 () {58 vars in 1170 bytes} [Mon Aug 8 02:43:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:43:00.420948 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3e426249-6d95-4717-9477-ac5a0a9bd599 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] Calling method '.version_select at 0x7f3295277af0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:00.501628 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3e426249-6d95-4717-9477-ac5a0a9bd599 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084252 Aug 08 02:43:00.502191 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 611/1211] 10.222.0.39 () {58 vars in 1155 bytes} [Mon Aug 8 02:43:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:43:00.514746 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3631e5e4-fb42-409b-9389-e43bc81d0ef0 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] Calling method '.version_select at 0x7f3295b3a8b0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:00.598974 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3631e5e4-fb42-409b-9389-e43bc81d0ef0 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087914 Aug 08 02:43:00.599543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 601/1212] 10.222.0.39 () {58 vars in 1188 bytes} [Mon Aug 8 02:43:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:43:00.612017 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-33beb705-0419-4f75-8531-fdcc33e9d083 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] Calling method '.version_select at 0x7f329501f3a0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:43:00.695969 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-33beb705-0419-4f75-8531-fdcc33e9d083 tempest-VolumesTestJSON-280597936 tempest-VolumesTestJSON-280597936-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087468 Aug 08 02:43:00.696620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 612/1213] 10.222.0.39 () {58 vars in 1155 bytes} [Mon Aug 8 02:43:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:43:51.137109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:51.137854 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:43:51.308471 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8e51226a-141e-46fa-a513-3e527c01abc5 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Action: 'create', calling method: .version_select at 0x7f329584c8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-991636141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiInV3DE1Xlq21YSju9ZR2Nvk0bsTMmAl/0AxKeNKs4EiWGR2U05w2gIDeWS1b3lknPOmXtrn+XhKhqKOz6WRYhOHFRM1R/YPBAszciZeRLyS6HQ7odVkdKrBgfbY3Vyw=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:43:51.323685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-8e51226a-141e-46fa-a513-3e527c01abc5 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Getting quotas for project 94219d4e012248139b9df01bcdf39bbc. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:43:51.327508 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-8e51226a-141e-46fa-a513-3e527c01abc5 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Getting quotas for user 57bd48dc29f945b9873334293d85b783 and project 94219d4e012248139b9df01bcdf39bbc. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:43:51.350419 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8e51226a-141e-46fa-a513-3e527c01abc5 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.214606 Aug 08 02:43:51.351021 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 602/1214] 10.222.0.39 () {60 vars in 1159 bytes} [Mon Aug 8 02:43:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:02.605586 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:02.606367 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:02.610766 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-691225974", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-819876671", "security_groups": [{"name": "tempest-secgroup-smoke-357897792"}], "block_device_mapping_v2": [{"uuid": "4bd58d12-1c71-47b9-8166-d1661147863e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a2a67ad0-5293-4294-ac4f-5a74fbe89f5a"}]}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:02.728125 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.network.neutron [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] validate_networks() for [('a2a67ad0-5293-4294-ac4f-5a74fbe89f5a', None, None, None, None, None)] {{(pid=117640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:44:03.229741 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Flavor limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:44:03.230154 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Image limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:44:03.230642 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Flavor pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:44:03.231039 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Image pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:44:03.231456 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:44:03.240703 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:03.241170 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:03.241621 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:03.242379 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:03.242828 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:03.243270 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:03.260141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Getting quotas for project 7a06a8947bd84ac398bf498d8816717c. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:44:03.264042 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Getting quotas for user 72485bc9ed6f4684b77b617597f99e29 and project 7a06a8947bd84ac398bf498d8816717c. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:44:03.327557 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Going to run 1 instances... {{(pid=117640) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:44:03.329937 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4bd58d12-1c71-47b9-8166-d1661147863e',volume_size=None,volume_type=None)] {{(pid=117640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:44:03.459814 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR oslo.messaging._drivers.impl_rabbit [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [323b223c-9852-4131-9c3d-973353f290db] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 02:44:03.523617 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:44:03.524229 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Mon Aug 8 02:44:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:44:04.468227 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [323b223c-9852-4131-9c3d-973353f290db] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 53378. Aug 08 02:44:04.472455 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-407919a4-1e60-4f21-bbf2-3fdca2e135f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.868695 Aug 08 02:44:04.473094 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 613/1215] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:44:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 02:44:04.481543 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:04.482314 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:04.486732 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b7b4a35e-4151-4e00-8ab8-cc3175f694f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:04.487346 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b7b4a35e-4151-4e00-8ab8-cc3175f694f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:04.543478 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b7b4a35e-4151-4e00-8ab8-cc3175f694f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:04.550186 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b7b4a35e-4151-4e00-8ab8-cc3175f694f8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1093 microversion: 2.1 time: 0.069859 Aug 08 02:44:04.550798 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 603/1216] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:04 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:05.571515 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-fc36c8ff-abb4-4229-ba90-7e10342c55a3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:05.572122 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-fc36c8ff-abb4-4229-ba90-7e10342c55a3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:05.623030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-fc36c8ff-abb4-4229-ba90-7e10342c55a3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:05.629528 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-fc36c8ff-abb4-4229-ba90-7e10342c55a3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1093 microversion: 2.1 time: 0.062987 Aug 08 02:44:05.630085 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 614/1217] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:05 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:06.650960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-453752cc-4781-4d57-9d9f-8a0bf13ea0f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:06.651586 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-453752cc-4781-4d57-9d9f-8a0bf13ea0f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:06.658160 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-453752cc-4781-4d57-9d9f-8a0bf13ea0f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:06.658676 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-453752cc-4781-4d57-9d9f-8a0bf13ea0f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:06.659334 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-453752cc-4781-4d57-9d9f-8a0bf13ea0f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:06.660039 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-453752cc-4781-4d57-9d9f-8a0bf13ea0f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:06.660487 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-453752cc-4781-4d57-9d9f-8a0bf13ea0f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:06.661104 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-453752cc-4781-4d57-9d9f-8a0bf13ea0f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:06.733354 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-453752cc-4781-4d57-9d9f-8a0bf13ea0f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:06.741149 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-453752cc-4781-4d57-9d9f-8a0bf13ea0f7 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1199 microversion: 2.1 time: 0.094005 Aug 08 02:44:06.742072 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 604/1218] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:06 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1199 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:07.762354 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-92247b54-7204-4234-b2de-64db546f946d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:07.762979 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-92247b54-7204-4234-b2de-64db546f946d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:07.769634 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92247b54-7204-4234-b2de-64db546f946d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:07.770113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92247b54-7204-4234-b2de-64db546f946d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:07.770647 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92247b54-7204-4234-b2de-64db546f946d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:07.772003 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92247b54-7204-4234-b2de-64db546f946d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:07.772550 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92247b54-7204-4234-b2de-64db546f946d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:07.773080 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-92247b54-7204-4234-b2de-64db546f946d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:07.989297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-92247b54-7204-4234-b2de-64db546f946d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:07.997271 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-92247b54-7204-4234-b2de-64db546f946d tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.238959 Aug 08 02:44:07.997833 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 615/1219] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:07 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:08.102103 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-ce96ea56-8675-48b1-bb4b-38d6ffc8e69f req-ecfbdeaf-58cc-4b12-8100-f049060e7941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79dc595d-ac88-4174-854c-cb2a8f0ea1c7", "tag": "efb966aa-2429-45da-a19d-e3445733bc00"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:08.113153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ce96ea56-8675-48b1-bb4b-38d6ffc8e69f req-ecfbdeaf-58cc-4b12-8100-f049060e7941 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:08.113986 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ce96ea56-8675-48b1-bb4b-38d6ffc8e69f req-ecfbdeaf-58cc-4b12-8100-f049060e7941 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:08.114955 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ce96ea56-8675-48b1-bb4b-38d6ffc8e69f req-ecfbdeaf-58cc-4b12-8100-f049060e7941 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:08.125943 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-ce96ea56-8675-48b1-bb4b-38d6ffc8e69f req-ecfbdeaf-58cc-4b12-8100-f049060e7941 service nova] Creating event network-changed:efb966aa-2429-45da-a19d-e3445733bc00 for instance 79dc595d-ac88-4174-854c-cb2a8f0ea1c7 on hv-cinder-73306 Aug 08 02:44:08.129378 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR oslo.messaging._drivers.impl_rabbit [req-ce96ea56-8675-48b1-bb4b-38d6ffc8e69f req-ecfbdeaf-58cc-4b12-8100-f049060e7941 service nova] [e6fcabf4-0676-4d70-932a-a7717c63d1ed] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 02:44:09.018393 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-cadf19da-a7ae-4762-8318-a788740d5dbd tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:09.018990 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-cadf19da-a7ae-4762-8318-a788740d5dbd tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:09.026223 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cadf19da-a7ae-4762-8318-a788740d5dbd tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:09.026727 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cadf19da-a7ae-4762-8318-a788740d5dbd tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:09.027165 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cadf19da-a7ae-4762-8318-a788740d5dbd tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:09.027852 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cadf19da-a7ae-4762-8318-a788740d5dbd tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:09.028302 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cadf19da-a7ae-4762-8318-a788740d5dbd tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:09.028723 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-cadf19da-a7ae-4762-8318-a788740d5dbd tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:09.138333 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [req-ce96ea56-8675-48b1-bb4b-38d6ffc8e69f req-ecfbdeaf-58cc-4b12-8100-f049060e7941 service nova] [e6fcabf4-0676-4d70-932a-a7717c63d1ed] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 53428. Aug 08 02:44:09.142611 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-ce96ea56-8675-48b1-bb4b-38d6ffc8e69f req-ecfbdeaf-58cc-4b12-8100-f049060e7941 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.044253 Aug 08 02:44:09.143229 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 605/1220] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:09.158207 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-cadf19da-a7ae-4762-8318-a788740d5dbd tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:09.165610 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-cadf19da-a7ae-4762-8318-a788740d5dbd tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.151077 Aug 08 02:44:09.166166 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 616/1221] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:09 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:44:10.186811 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6d81bd18-818c-4105-9a1c-0a8365defae1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:10.187474 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6d81bd18-818c-4105-9a1c-0a8365defae1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:10.194494 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d81bd18-818c-4105-9a1c-0a8365defae1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:10.194960 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d81bd18-818c-4105-9a1c-0a8365defae1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:10.195394 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d81bd18-818c-4105-9a1c-0a8365defae1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:10.196075 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d81bd18-818c-4105-9a1c-0a8365defae1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:10.196521 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d81bd18-818c-4105-9a1c-0a8365defae1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:10.196940 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d81bd18-818c-4105-9a1c-0a8365defae1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:10.330711 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6d81bd18-818c-4105-9a1c-0a8365defae1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:10.338603 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6d81bd18-818c-4105-9a1c-0a8365defae1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.156525 Aug 08 02:44:10.339171 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 606/1222] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:10 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:11.359047 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5950b2a5-f144-42a3-8b7d-a86917a01e6f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:11.359663 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5950b2a5-f144-42a3-8b7d-a86917a01e6f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:11.366672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5950b2a5-f144-42a3-8b7d-a86917a01e6f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:11.367147 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5950b2a5-f144-42a3-8b7d-a86917a01e6f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:11.367580 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5950b2a5-f144-42a3-8b7d-a86917a01e6f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:11.368263 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5950b2a5-f144-42a3-8b7d-a86917a01e6f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:11.368717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5950b2a5-f144-42a3-8b7d-a86917a01e6f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:11.369137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5950b2a5-f144-42a3-8b7d-a86917a01e6f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:11.500491 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-5950b2a5-f144-42a3-8b7d-a86917a01e6f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:11.507924 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5950b2a5-f144-42a3-8b7d-a86917a01e6f tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.152722 Aug 08 02:44:11.508480 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 617/1223] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:11 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:12.528707 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-88e2e607-55be-4c49-ad78-c89d20190b4c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:12.529256 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-88e2e607-55be-4c49-ad78-c89d20190b4c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:12.535622 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88e2e607-55be-4c49-ad78-c89d20190b4c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:12.536102 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88e2e607-55be-4c49-ad78-c89d20190b4c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:12.536532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88e2e607-55be-4c49-ad78-c89d20190b4c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:12.537218 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88e2e607-55be-4c49-ad78-c89d20190b4c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:12.537666 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88e2e607-55be-4c49-ad78-c89d20190b4c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:12.538090 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88e2e607-55be-4c49-ad78-c89d20190b4c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:12.665275 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-88e2e607-55be-4c49-ad78-c89d20190b4c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:12.672527 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-88e2e607-55be-4c49-ad78-c89d20190b4c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.147792 Aug 08 02:44:12.673091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 607/1224] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:12 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:13.694174 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-bc28fb49-3396-4590-9c08-7dbf9b93b853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:13.694836 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-bc28fb49-3396-4590-9c08-7dbf9b93b853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:13.697155 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:13.702489 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bc28fb49-3396-4590-9c08-7dbf9b93b853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:13.702967 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bc28fb49-3396-4590-9c08-7dbf9b93b853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:13.703403 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bc28fb49-3396-4590-9c08-7dbf9b93b853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:13.704115 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bc28fb49-3396-4590-9c08-7dbf9b93b853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:13.704563 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bc28fb49-3396-4590-9c08-7dbf9b93b853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:13.704986 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bc28fb49-3396-4590-9c08-7dbf9b93b853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:13.839198 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-bc28fb49-3396-4590-9c08-7dbf9b93b853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:13.846672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-bc28fb49-3396-4590-9c08-7dbf9b93b853 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.157118 Aug 08 02:44:13.847409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 618/1225] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:13 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:14.867575 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b17e2881-fd4e-486c-a730-ab2e55af3487 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:14.868212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b17e2881-fd4e-486c-a730-ab2e55af3487 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:14.870748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:14.881259 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b17e2881-fd4e-486c-a730-ab2e55af3487 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:14.881744 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b17e2881-fd4e-486c-a730-ab2e55af3487 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:14.882172 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b17e2881-fd4e-486c-a730-ab2e55af3487 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:14.882918 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b17e2881-fd4e-486c-a730-ab2e55af3487 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:14.883365 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b17e2881-fd4e-486c-a730-ab2e55af3487 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:14.883780 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b17e2881-fd4e-486c-a730-ab2e55af3487 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:14.951027 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1170569451", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-991636141", "security_groups": [{"name": "tempest-secgroup-smoke-1088115547"}], "networks": [{"uuid": "a2d52eba-6f19-46f4-b26b-91db15434d6c"}], "block_device_mapping_v2": [{"uuid": "de1e7fcb-8a19-4ead-94f5-cfad74744667", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:15.019780 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b17e2881-fd4e-486c-a730-ab2e55af3487 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:15.027764 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b17e2881-fd4e-486c-a730-ab2e55af3487 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.164116 Aug 08 02:44:15.028337 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 608/1226] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:14 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:15.063525 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.network.neutron [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] validate_networks() for [('a2d52eba-6f19-46f4-b26b-91db15434d6c', None, None, None, None, None)] {{(pid=117640) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 02:44:15.441410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Flavor limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 02:44:15.441828 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Image limits 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 02:44:15.442353 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Flavor pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 02:44:15.442764 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Image pref 0:0:0 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 02:44:15.443173 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.virt.hardware [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 02:44:15.452026 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:15.452501 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:15.452932 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:15.453679 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:15.454129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:15.454584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:15.471545 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Getting quotas for project 94219d4e012248139b9df01bcdf39bbc. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 02:44:15.475987 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.quota [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Getting quotas for user 57bd48dc29f945b9873334293d85b783 and project 94219d4e012248139b9df01bcdf39bbc. Resources: {'instances', 'ram', 'cores'} {{(pid=117640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 02:44:15.532464 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Going to run 1 instances... {{(pid=117640) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 02:44:15.534519 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de1e7fcb-8a19-4ead-94f5-cfad74744667',volume_size=None,volume_type=None)] {{(pid=117640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 02:44:15.659482 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-83775f5e-e3c3-40ad-aeb5-a8ea03d61039 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712409 Aug 08 02:44:15.660425 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 619/1227] 10.222.0.39 () {60 vars in 1147 bytes} [Mon Aug 8 02:44:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 08 02:44:15.671556 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-701ee86e-4469-4d42-a633-7492e5a34ae1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:15.672174 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-701ee86e-4469-4d42-a633-7492e5a34ae1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:15.726477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-701ee86e-4469-4d42-a633-7492e5a34ae1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:15.733196 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-701ee86e-4469-4d42-a633-7492e5a34ae1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1088 microversion: 2.1 time: 0.065564 Aug 08 02:44:15.733760 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 609/1228] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:15 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:16.049131 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-07781f70-c417-493b-bbbc-b2aaf20bc44a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:16.049747 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-07781f70-c417-493b-bbbc-b2aaf20bc44a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:16.056926 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-07781f70-c417-493b-bbbc-b2aaf20bc44a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:16.057401 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-07781f70-c417-493b-bbbc-b2aaf20bc44a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:16.057834 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-07781f70-c417-493b-bbbc-b2aaf20bc44a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:16.058541 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-07781f70-c417-493b-bbbc-b2aaf20bc44a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:16.058990 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-07781f70-c417-493b-bbbc-b2aaf20bc44a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:16.059409 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-07781f70-c417-493b-bbbc-b2aaf20bc44a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:16.190722 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-07781f70-c417-493b-bbbc-b2aaf20bc44a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:16.198749 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-07781f70-c417-493b-bbbc-b2aaf20bc44a tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.154057 Aug 08 02:44:16.199312 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 620/1229] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:16 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:16.753605 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-413c8e45-d069-4b46-8508-77b8aabca6a3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:16.754143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-413c8e45-d069-4b46-8508-77b8aabca6a3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:16.761036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-413c8e45-d069-4b46-8508-77b8aabca6a3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:16.761515 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-413c8e45-d069-4b46-8508-77b8aabca6a3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:16.761948 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-413c8e45-d069-4b46-8508-77b8aabca6a3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:16.762656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-413c8e45-d069-4b46-8508-77b8aabca6a3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:16.763104 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-413c8e45-d069-4b46-8508-77b8aabca6a3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:16.763523 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-413c8e45-d069-4b46-8508-77b8aabca6a3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:16.825293 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-413c8e45-d069-4b46-8508-77b8aabca6a3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:16.832673 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-413c8e45-d069-4b46-8508-77b8aabca6a3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1138 microversion: 2.1 time: 0.083115 Aug 08 02:44:16.833729 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 610/1230] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:16 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:17.218561 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-de75d1e4-2c60-46db-9257-8acd68860fe8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:17.219311 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-de75d1e4-2c60-46db-9257-8acd68860fe8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:17.225845 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de75d1e4-2c60-46db-9257-8acd68860fe8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:17.226363 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de75d1e4-2c60-46db-9257-8acd68860fe8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:17.226806 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de75d1e4-2c60-46db-9257-8acd68860fe8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:17.227500 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de75d1e4-2c60-46db-9257-8acd68860fe8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:17.227952 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de75d1e4-2c60-46db-9257-8acd68860fe8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:17.228380 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-de75d1e4-2c60-46db-9257-8acd68860fe8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:17.364076 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-de75d1e4-2c60-46db-9257-8acd68860fe8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:17.371630 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-de75d1e4-2c60-46db-9257-8acd68860fe8 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.157110 Aug 08 02:44:17.372196 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 621/1231] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:17 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:17.854168 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-11e48461-f659-4ad0-b831-69dc2fe612bd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:17.854918 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-11e48461-f659-4ad0-b831-69dc2fe612bd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:17.861399 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11e48461-f659-4ad0-b831-69dc2fe612bd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:17.861946 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11e48461-f659-4ad0-b831-69dc2fe612bd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:17.862472 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11e48461-f659-4ad0-b831-69dc2fe612bd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:17.863263 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11e48461-f659-4ad0-b831-69dc2fe612bd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:17.863779 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11e48461-f659-4ad0-b831-69dc2fe612bd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:17.864802 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11e48461-f659-4ad0-b831-69dc2fe612bd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:17.927844 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-11e48461-f659-4ad0-b831-69dc2fe612bd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:17.935414 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-11e48461-f659-4ad0-b831-69dc2fe612bd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1204 microversion: 2.1 time: 0.085167 Aug 08 02:44:17.935988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 611/1232] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:17 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1204 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:18.393139 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d3295460-1b5d-4d96-ae76-2369a5eeea25 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:18.393759 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d3295460-1b5d-4d96-ae76-2369a5eeea25 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:18.401073 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d3295460-1b5d-4d96-ae76-2369a5eeea25 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:18.401551 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d3295460-1b5d-4d96-ae76-2369a5eeea25 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:18.402172 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d3295460-1b5d-4d96-ae76-2369a5eeea25 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:18.403247 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d3295460-1b5d-4d96-ae76-2369a5eeea25 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:18.403914 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d3295460-1b5d-4d96-ae76-2369a5eeea25 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:18.405302 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d3295460-1b5d-4d96-ae76-2369a5eeea25 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:18.683910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d3295460-1b5d-4d96-ae76-2369a5eeea25 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:18.694058 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d3295460-1b5d-4d96-ae76-2369a5eeea25 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.305176 Aug 08 02:44:18.708625 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 622/1233] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:18 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:18.958574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0598f4e1-cfa1-40c8-835c-1894071c671f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:18.959214 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0598f4e1-cfa1-40c8-835c-1894071c671f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:18.965607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0598f4e1-cfa1-40c8-835c-1894071c671f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:18.966146 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0598f4e1-cfa1-40c8-835c-1894071c671f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:18.966603 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0598f4e1-cfa1-40c8-835c-1894071c671f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:18.967289 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0598f4e1-cfa1-40c8-835c-1894071c671f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:18.967730 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0598f4e1-cfa1-40c8-835c-1894071c671f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:18.968141 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0598f4e1-cfa1-40c8-835c-1894071c671f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:19.069525 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-a5048d0b-2495-4561-8965-df2d1bc50a38 req-87409321-da07-47d8-91e3-5cd678cfd083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59870f0a-23af-4ce5-ad4b-31164db7730b", "tag": "55d4bd39-d798-4f0b-b93f-f29df0ceaecf"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:19.079342 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-a5048d0b-2495-4561-8965-df2d1bc50a38 req-87409321-da07-47d8-91e3-5cd678cfd083 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:19.080283 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-a5048d0b-2495-4561-8965-df2d1bc50a38 req-87409321-da07-47d8-91e3-5cd678cfd083 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:19.081045 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-a5048d0b-2495-4561-8965-df2d1bc50a38 req-87409321-da07-47d8-91e3-5cd678cfd083 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:19.094031 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-a5048d0b-2495-4561-8965-df2d1bc50a38 req-87409321-da07-47d8-91e3-5cd678cfd083 service nova] Creating event network-changed:55d4bd39-d798-4f0b-b93f-f29df0ceaecf for instance 59870f0a-23af-4ce5-ad4b-31164db7730b on hv-cinder-73306 Aug 08 02:44:19.099905 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-a5048d0b-2495-4561-8965-df2d1bc50a38 req-87409321-da07-47d8-91e3-5cd678cfd083 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034495 Aug 08 02:44:19.101113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 623/1234] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:44:19.107149 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0598f4e1-cfa1-40c8-835c-1894071c671f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:19.115007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0598f4e1-cfa1-40c8-835c-1894071c671f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1260 microversion: 2.1 time: 0.160184 Aug 08 02:44:19.115953 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 612/1235] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:18 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:19.716769 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-be530722-36c6-432a-908d-bea277d79112 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:19.717396 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-be530722-36c6-432a-908d-bea277d79112 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:19.724061 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-be530722-36c6-432a-908d-bea277d79112 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:19.724536 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-be530722-36c6-432a-908d-bea277d79112 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:19.724970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-be530722-36c6-432a-908d-bea277d79112 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:19.725652 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-be530722-36c6-432a-908d-bea277d79112 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:19.726103 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-be530722-36c6-432a-908d-bea277d79112 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:19.726549 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-be530722-36c6-432a-908d-bea277d79112 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:19.862544 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-be530722-36c6-432a-908d-bea277d79112 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:19.869957 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-be530722-36c6-432a-908d-bea277d79112 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.157920 Aug 08 02:44:19.870552 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 624/1236] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:19 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:20.136118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2bfeb8b5-fc90-45e6-b2a1-3fe3a1e70128 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:20.136729 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2bfeb8b5-fc90-45e6-b2a1-3fe3a1e70128 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:20.143088 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bfeb8b5-fc90-45e6-b2a1-3fe3a1e70128 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:20.143555 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bfeb8b5-fc90-45e6-b2a1-3fe3a1e70128 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:20.143980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bfeb8b5-fc90-45e6-b2a1-3fe3a1e70128 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:20.144652 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bfeb8b5-fc90-45e6-b2a1-3fe3a1e70128 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:20.145094 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bfeb8b5-fc90-45e6-b2a1-3fe3a1e70128 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:20.145997 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bfeb8b5-fc90-45e6-b2a1-3fe3a1e70128 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:20.274648 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2bfeb8b5-fc90-45e6-b2a1-3fe3a1e70128 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:20.281931 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2bfeb8b5-fc90-45e6-b2a1-3fe3a1e70128 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1260 microversion: 2.1 time: 0.149639 Aug 08 02:44:20.282523 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 613/1237] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:20 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:20.586991 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-0b28a60c-2aae-4a23-b8da-f0aa51beaf87 req-6cfb5db0-346a-46bb-a641-2190cc4a62c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79dc595d-ac88-4174-854c-cb2a8f0ea1c7", "name": "network-vif-plugged", "status": "completed", "tag": "efb966aa-2429-45da-a19d-e3445733bc00"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:20.599431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-0b28a60c-2aae-4a23-b8da-f0aa51beaf87 req-6cfb5db0-346a-46bb-a641-2190cc4a62c1 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:20.599991 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-0b28a60c-2aae-4a23-b8da-f0aa51beaf87 req-6cfb5db0-346a-46bb-a641-2190cc4a62c1 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:20.600485 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-0b28a60c-2aae-4a23-b8da-f0aa51beaf87 req-6cfb5db0-346a-46bb-a641-2190cc4a62c1 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:20.612156 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-0b28a60c-2aae-4a23-b8da-f0aa51beaf87 req-6cfb5db0-346a-46bb-a641-2190cc4a62c1 service nova] Creating event network-vif-plugged:efb966aa-2429-45da-a19d-e3445733bc00 for instance 79dc595d-ac88-4174-854c-cb2a8f0ea1c7 on hv-cinder-73306 Aug 08 02:44:20.618010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-0b28a60c-2aae-4a23-b8da-f0aa51beaf87 req-6cfb5db0-346a-46bb-a641-2190cc4a62c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035917 Aug 08 02:44:20.618988 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 625/1238] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:44:20.890344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-42a3523c-6129-441c-a6ed-5cc5ef11272e tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:20.890973 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-42a3523c-6129-441c-a6ed-5cc5ef11272e tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:20.897445 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42a3523c-6129-441c-a6ed-5cc5ef11272e tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:20.898203 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42a3523c-6129-441c-a6ed-5cc5ef11272e tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:20.898861 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42a3523c-6129-441c-a6ed-5cc5ef11272e tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:20.899569 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42a3523c-6129-441c-a6ed-5cc5ef11272e tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:20.900199 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42a3523c-6129-441c-a6ed-5cc5ef11272e tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:20.900626 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42a3523c-6129-441c-a6ed-5cc5ef11272e tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:21.037651 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-42a3523c-6129-441c-a6ed-5cc5ef11272e tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:21.045405 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-42a3523c-6129-441c-a6ed-5cc5ef11272e tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.158787 Aug 08 02:44:21.045849 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 614/1239] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:20 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:21.302170 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a4dde1bb-50f8-469e-a50b-81c566d2f801 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:21.302881 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-a4dde1bb-50f8-469e-a50b-81c566d2f801 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:21.309431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a4dde1bb-50f8-469e-a50b-81c566d2f801 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:21.309901 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a4dde1bb-50f8-469e-a50b-81c566d2f801 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:21.310344 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a4dde1bb-50f8-469e-a50b-81c566d2f801 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:21.311020 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a4dde1bb-50f8-469e-a50b-81c566d2f801 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:21.311462 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a4dde1bb-50f8-469e-a50b-81c566d2f801 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:21.311876 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-a4dde1bb-50f8-469e-a50b-81c566d2f801 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:21.446595 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-a4dde1bb-50f8-469e-a50b-81c566d2f801 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:21.454133 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a4dde1bb-50f8-469e-a50b-81c566d2f801 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1260 microversion: 2.1 time: 0.156133 Aug 08 02:44:21.454728 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 626/1240] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:21 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:22.066618 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-73b734c5-a422-429f-8525-4b252e0bf383 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:22.067787 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-73b734c5-a422-429f-8525-4b252e0bf383 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:22.074159 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73b734c5-a422-429f-8525-4b252e0bf383 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:22.074678 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73b734c5-a422-429f-8525-4b252e0bf383 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:22.075109 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73b734c5-a422-429f-8525-4b252e0bf383 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:22.075839 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73b734c5-a422-429f-8525-4b252e0bf383 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:22.076241 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73b734c5-a422-429f-8525-4b252e0bf383 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:22.076666 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73b734c5-a422-429f-8525-4b252e0bf383 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:22.205011 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-73b734c5-a422-429f-8525-4b252e0bf383 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:22.212423 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-73b734c5-a422-429f-8525-4b252e0bf383 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1264 microversion: 2.1 time: 0.149957 Aug 08 02:44:22.212991 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 615/1241] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:22 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:22.475493 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-9f5f83a6-b951-41b7-acd2-469428fa58ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:22.476129 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-9f5f83a6-b951-41b7-acd2-469428fa58ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:22.482496 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9f5f83a6-b951-41b7-acd2-469428fa58ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:22.482975 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9f5f83a6-b951-41b7-acd2-469428fa58ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:22.483401 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9f5f83a6-b951-41b7-acd2-469428fa58ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:22.484117 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9f5f83a6-b951-41b7-acd2-469428fa58ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:22.484569 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9f5f83a6-b951-41b7-acd2-469428fa58ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:22.484986 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-9f5f83a6-b951-41b7-acd2-469428fa58ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:22.614794 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-9f5f83a6-b951-41b7-acd2-469428fa58ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:22.622180 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-9f5f83a6-b951-41b7-acd2-469428fa58ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1260 microversion: 2.1 time: 0.151099 Aug 08 02:44:22.622764 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 627/1242] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:22 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:23.232798 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-91ac24c4-a981-4341-b680-eff6e33545f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:23.233431 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-91ac24c4-a981-4341-b680-eff6e33545f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:23.239710 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91ac24c4-a981-4341-b680-eff6e33545f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:23.240209 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91ac24c4-a981-4341-b680-eff6e33545f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:23.240636 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91ac24c4-a981-4341-b680-eff6e33545f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:23.241317 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91ac24c4-a981-4341-b680-eff6e33545f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:23.241759 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91ac24c4-a981-4341-b680-eff6e33545f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:23.242176 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91ac24c4-a981-4341-b680-eff6e33545f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:23.376114 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-91ac24c4-a981-4341-b680-eff6e33545f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:23.384035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-91ac24c4-a981-4341-b680-eff6e33545f1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1450 microversion: 2.1 time: 0.155124 Aug 08 02:44:23.384599 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 616/1243] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:23 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:23.404097 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-afdde6fb-2cba-414f-a4c0-332cc3a1cdc1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:23.404705 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-afdde6fb-2cba-414f-a4c0-332cc3a1cdc1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:23.410545 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afdde6fb-2cba-414f-a4c0-332cc3a1cdc1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:23.411075 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afdde6fb-2cba-414f-a4c0-332cc3a1cdc1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:23.411505 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afdde6fb-2cba-414f-a4c0-332cc3a1cdc1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:23.412184 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afdde6fb-2cba-414f-a4c0-332cc3a1cdc1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:23.412634 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afdde6fb-2cba-414f-a4c0-332cc3a1cdc1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:23.413058 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-afdde6fb-2cba-414f-a4c0-332cc3a1cdc1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:23.540183 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-afdde6fb-2cba-414f-a4c0-332cc3a1cdc1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:23.547708 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-afdde6fb-2cba-414f-a4c0-332cc3a1cdc1 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1450 microversion: 2.1 time: 0.147398 Aug 08 02:44:23.548273 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 628/1244] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:23 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:23.642574 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6daa1418-1a9a-4601-89f3-02cc9610beba tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:23.643189 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6daa1418-1a9a-4601-89f3-02cc9610beba tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:23.648985 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6daa1418-1a9a-4601-89f3-02cc9610beba tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:23.649465 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6daa1418-1a9a-4601-89f3-02cc9610beba tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:23.649906 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6daa1418-1a9a-4601-89f3-02cc9610beba tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:23.650621 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6daa1418-1a9a-4601-89f3-02cc9610beba tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:23.651073 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6daa1418-1a9a-4601-89f3-02cc9610beba tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:23.651493 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6daa1418-1a9a-4601-89f3-02cc9610beba tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:23.781773 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6daa1418-1a9a-4601-89f3-02cc9610beba tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:23.789304 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6daa1418-1a9a-4601-89f3-02cc9610beba tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1260 microversion: 2.1 time: 0.150634 Aug 08 02:44:23.789877 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 617/1245] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:23 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:24.810584 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-63afec60-5293-4181-93eb-0299cbc9c608 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:24.811201 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-63afec60-5293-4181-93eb-0299cbc9c608 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:24.818613 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-63afec60-5293-4181-93eb-0299cbc9c608 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:24.819096 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-63afec60-5293-4181-93eb-0299cbc9c608 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:24.819528 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-63afec60-5293-4181-93eb-0299cbc9c608 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:24.820216 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-63afec60-5293-4181-93eb-0299cbc9c608 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:24.820668 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-63afec60-5293-4181-93eb-0299cbc9c608 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:24.821095 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-63afec60-5293-4181-93eb-0299cbc9c608 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:25.307336 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-63afec60-5293-4181-93eb-0299cbc9c608 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:25.314578 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-63afec60-5293-4181-93eb-0299cbc9c608 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1260 microversion: 2.1 time: 0.507885 Aug 08 02:44:25.315141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 629/1246] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:24 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1260 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:25.540558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-0f2a103f-1ced-4bae-ad4d-4ca9d3d0e494 req-710aa4a6-c923-47c2-a264-51c5b214207f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79dc595d-ac88-4174-854c-cb2a8f0ea1c7", "tag": "efb966aa-2429-45da-a19d-e3445733bc00"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:25.550344 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-0f2a103f-1ced-4bae-ad4d-4ca9d3d0e494 req-710aa4a6-c923-47c2-a264-51c5b214207f service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:25.550822 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-0f2a103f-1ced-4bae-ad4d-4ca9d3d0e494 req-710aa4a6-c923-47c2-a264-51c5b214207f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:25.551253 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-0f2a103f-1ced-4bae-ad4d-4ca9d3d0e494 req-710aa4a6-c923-47c2-a264-51c5b214207f service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:25.563036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-0f2a103f-1ced-4bae-ad4d-4ca9d3d0e494 req-710aa4a6-c923-47c2-a264-51c5b214207f service nova] Creating event network-changed:efb966aa-2429-45da-a19d-e3445733bc00 for instance 79dc595d-ac88-4174-854c-cb2a8f0ea1c7 on hv-cinder-73306 Aug 08 02:44:25.569071 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-0f2a103f-1ced-4bae-ad4d-4ca9d3d0e494 req-710aa4a6-c923-47c2-a264-51c5b214207f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033417 Aug 08 02:44:25.569672 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 618/1247] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:26.335877 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7dc1007f-b39f-49eb-83de-c83110821e1c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:26.336486 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7dc1007f-b39f-49eb-83de-c83110821e1c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:26.338475 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:26.339127 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell0:SELECT=14 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:26.346092 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7dc1007f-b39f-49eb-83de-c83110821e1c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:26.346596 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7dc1007f-b39f-49eb-83de-c83110821e1c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:26.347025 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7dc1007f-b39f-49eb-83de-c83110821e1c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:26.347704 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7dc1007f-b39f-49eb-83de-c83110821e1c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:26.348702 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7dc1007f-b39f-49eb-83de-c83110821e1c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:26.349098 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7dc1007f-b39f-49eb-83de-c83110821e1c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:26.487234 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7dc1007f-b39f-49eb-83de-c83110821e1c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:26.495690 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7dc1007f-b39f-49eb-83de-c83110821e1c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1260 microversion: 2.1 time: 0.163779 Aug 08 02:44:26.496241 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 630/1248] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:26 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:27.516468 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6ddc9e0c-3f6c-4fd6-8bf8-d711b90189d4 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:27.517158 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6ddc9e0c-3f6c-4fd6-8bf8-d711b90189d4 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:27.519153 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:27.525081 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ddc9e0c-3f6c-4fd6-8bf8-d711b90189d4 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:27.525548 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ddc9e0c-3f6c-4fd6-8bf8-d711b90189d4 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:27.525975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ddc9e0c-3f6c-4fd6-8bf8-d711b90189d4 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:27.526695 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ddc9e0c-3f6c-4fd6-8bf8-d711b90189d4 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:27.527140 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ddc9e0c-3f6c-4fd6-8bf8-d711b90189d4 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:27.527553 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ddc9e0c-3f6c-4fd6-8bf8-d711b90189d4 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:27.657022 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6ddc9e0c-3f6c-4fd6-8bf8-d711b90189d4 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:27.664895 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6ddc9e0c-3f6c-4fd6-8bf8-d711b90189d4 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1260 microversion: 2.1 time: 0.152622 Aug 08 02:44:27.665454 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 619/1249] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:27 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:28.686204 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-4b91e723-95ef-461a-aaf1-156d90e8b064 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:28.686849 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-4b91e723-95ef-461a-aaf1-156d90e8b064 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:28.693469 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4b91e723-95ef-461a-aaf1-156d90e8b064 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:28.693946 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4b91e723-95ef-461a-aaf1-156d90e8b064 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:28.694405 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4b91e723-95ef-461a-aaf1-156d90e8b064 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:28.695095 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4b91e723-95ef-461a-aaf1-156d90e8b064 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:28.695545 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4b91e723-95ef-461a-aaf1-156d90e8b064 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:28.696004 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-4b91e723-95ef-461a-aaf1-156d90e8b064 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:28.824380 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-4b91e723-95ef-461a-aaf1-156d90e8b064 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:28.831751 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-4b91e723-95ef-461a-aaf1-156d90e8b064 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1260 microversion: 2.1 time: 0.149430 Aug 08 02:44:28.832308 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 631/1250] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:28 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:29.851938 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f6f2cf6e-d118-4b4d-bf84-1d5192bb5684 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:29.852544 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f6f2cf6e-d118-4b4d-bf84-1d5192bb5684 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:29.858956 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6f2cf6e-d118-4b4d-bf84-1d5192bb5684 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:29.859430 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6f2cf6e-d118-4b4d-bf84-1d5192bb5684 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:29.859854 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6f2cf6e-d118-4b4d-bf84-1d5192bb5684 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:29.860531 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6f2cf6e-d118-4b4d-bf84-1d5192bb5684 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:29.860973 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6f2cf6e-d118-4b4d-bf84-1d5192bb5684 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:29.861387 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6f2cf6e-d118-4b4d-bf84-1d5192bb5684 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:29.998754 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f6f2cf6e-d118-4b4d-bf84-1d5192bb5684 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:30.009221 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f6f2cf6e-d118-4b4d-bf84-1d5192bb5684 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1260 microversion: 2.1 time: 0.161120 Aug 08 02:44:30.009781 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 620/1251] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:29 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:30.623027 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-dd1672db-eb7f-4beb-bcc6-6e5eeaaa13b1 req-50009065-1a79-4b48-bed7-4755b20758e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59870f0a-23af-4ce5-ad4b-31164db7730b", "name": "network-vif-plugged", "status": "completed", "tag": "55d4bd39-d798-4f0b-b93f-f29df0ceaecf"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:30.633236 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-dd1672db-eb7f-4beb-bcc6-6e5eeaaa13b1 req-50009065-1a79-4b48-bed7-4755b20758e3 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:30.633713 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-dd1672db-eb7f-4beb-bcc6-6e5eeaaa13b1 req-50009065-1a79-4b48-bed7-4755b20758e3 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:30.634139 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-dd1672db-eb7f-4beb-bcc6-6e5eeaaa13b1 req-50009065-1a79-4b48-bed7-4755b20758e3 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:30.645966 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-dd1672db-eb7f-4beb-bcc6-6e5eeaaa13b1 req-50009065-1a79-4b48-bed7-4755b20758e3 service nova] Creating event network-vif-plugged:55d4bd39-d798-4f0b-b93f-f29df0ceaecf for instance 59870f0a-23af-4ce5-ad4b-31164db7730b on hv-cinder-73306 Aug 08 02:44:30.651426 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-dd1672db-eb7f-4beb-bcc6-6e5eeaaa13b1 req-50009065-1a79-4b48-bed7-4755b20758e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032034 Aug 08 02:44:30.652459 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 632/1252] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:44:31.029413 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-08534b52-657c-47b2-a233-1b0ddb7f78c2 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:31.030063 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-08534b52-657c-47b2-a233-1b0ddb7f78c2 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:31.036500 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08534b52-657c-47b2-a233-1b0ddb7f78c2 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:31.037020 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08534b52-657c-47b2-a233-1b0ddb7f78c2 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:31.037458 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08534b52-657c-47b2-a233-1b0ddb7f78c2 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:31.038147 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08534b52-657c-47b2-a233-1b0ddb7f78c2 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:31.038632 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08534b52-657c-47b2-a233-1b0ddb7f78c2 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:31.039060 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-08534b52-657c-47b2-a233-1b0ddb7f78c2 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:31.166021 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-08534b52-657c-47b2-a233-1b0ddb7f78c2 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:31.173437 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-08534b52-657c-47b2-a233-1b0ddb7f78c2 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1260 microversion: 2.1 time: 0.147858 Aug 08 02:44:31.174007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 621/1253] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:31 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:32.196323 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-41629fcd-2400-4427-83f6-69808af68a36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:32.196949 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-41629fcd-2400-4427-83f6-69808af68a36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:32.203190 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41629fcd-2400-4427-83f6-69808af68a36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:32.203667 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41629fcd-2400-4427-83f6-69808af68a36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:32.204095 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41629fcd-2400-4427-83f6-69808af68a36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:32.204778 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41629fcd-2400-4427-83f6-69808af68a36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:32.205229 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41629fcd-2400-4427-83f6-69808af68a36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:32.205649 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-41629fcd-2400-4427-83f6-69808af68a36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:32.337819 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-41629fcd-2400-4427-83f6-69808af68a36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:32.341772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=100 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:32.346394 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-41629fcd-2400-4427-83f6-69808af68a36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1260 microversion: 2.1 time: 0.155733 Aug 08 02:44:32.347330 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 633/1254] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:32 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:33.367060 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-86079b14-f839-456e-83eb-b695f9fd805c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:33.367676 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-86079b14-f839-456e-83eb-b695f9fd805c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:33.374045 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86079b14-f839-456e-83eb-b695f9fd805c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:33.374551 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86079b14-f839-456e-83eb-b695f9fd805c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:33.374986 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86079b14-f839-456e-83eb-b695f9fd805c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:33.375670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86079b14-f839-456e-83eb-b695f9fd805c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:33.376121 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86079b14-f839-456e-83eb-b695f9fd805c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:33.376537 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-86079b14-f839-456e-83eb-b695f9fd805c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:33.508020 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-86079b14-f839-456e-83eb-b695f9fd805c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:33.511422 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:33.516308 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-86079b14-f839-456e-83eb-b695f9fd805c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1444 microversion: 2.1 time: 0.153219 Aug 08 02:44:33.516875 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 622/1255] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:33 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:33.537467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7fb595e9-baaf-4599-9881-b9840e1f1d6d tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:44:33.538072 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7fb595e9-baaf-4599-9881-b9840e1f1d6d tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:44:33.540432 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:33.546169 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7fb595e9-baaf-4599-9881-b9840e1f1d6d tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:33.546669 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7fb595e9-baaf-4599-9881-b9840e1f1d6d tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:33.547097 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7fb595e9-baaf-4599-9881-b9840e1f1d6d tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:33.547773 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7fb595e9-baaf-4599-9881-b9840e1f1d6d tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:33.548215 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7fb595e9-baaf-4599-9881-b9840e1f1d6d tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:33.548629 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7fb595e9-baaf-4599-9881-b9840e1f1d6d tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:33.679386 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7fb595e9-baaf-4599-9881-b9840e1f1d6d tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:44:33.686828 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7fb595e9-baaf-4599-9881-b9840e1f1d6d tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1444 microversion: 2.1 time: 0.154259 Aug 08 02:44:33.687389 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 634/1256] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:44:33 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:44:35.274590 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-35354b59-e5d4-4aeb-bc29-f7372e049b27 req-be255d2f-711f-4a04-b481-657ab1f0c622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59870f0a-23af-4ce5-ad4b-31164db7730b", "tag": "55d4bd39-d798-4f0b-b93f-f29df0ceaecf"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:44:35.279945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=45 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:44:35.285830 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-35354b59-e5d4-4aeb-bc29-f7372e049b27 req-be255d2f-711f-4a04-b481-657ab1f0c622 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:44:35.286326 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-35354b59-e5d4-4aeb-bc29-f7372e049b27 req-be255d2f-711f-4a04-b481-657ab1f0c622 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:44:35.286755 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-35354b59-e5d4-4aeb-bc29-f7372e049b27 req-be255d2f-711f-4a04-b481-657ab1f0c622 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:44:35.297891 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-35354b59-e5d4-4aeb-bc29-f7372e049b27 req-be255d2f-711f-4a04-b481-657ab1f0c622 service nova] Creating event network-changed:55d4bd39-d798-4f0b-b93f-f29df0ceaecf for instance 59870f0a-23af-4ce5-ad4b-31164db7730b on hv-cinder-73306 Aug 08 02:44:35.302852 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-35354b59-e5d4-4aeb-bc29-f7372e049b27 req-be255d2f-711f-4a04-b481-657ab1f0c622 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032775 Aug 08 02:44:35.303452 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 623/1257] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:45:36.932926 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:45:36.933541 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Mon Aug 8 02:45:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:46:15.875410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e808de9c-1017-4caa-b23e-910459344786 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:15.876080 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e808de9c-1017-4caa-b23e-910459344786 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:15.876649 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db49a9c1-a60a-4eb6-bf29-211b2d41050f] AMQP server on 10.222.0.39:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 08 02:46:15.877188 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:15.878535 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:15.885797 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR oslo.messaging._drivers.impl_rabbit [-] [014384fb-cbbd-4c9f-acee-c2152307a229] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 08 02:46:15.887822 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-7b4b7ba2-93cd-456e-903a-79de7939b23f req-a4ae6a72-60e9-4bbe-a533-7a550d181baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79dc595d-ac88-4174-854c-cb2a8f0ea1c7", "tag": "efb966aa-2429-45da-a19d-e3445733bc00"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:46:15.889747 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:15.890550 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=6 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:15.897154 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e808de9c-1017-4caa-b23e-910459344786 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:15.897637 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e808de9c-1017-4caa-b23e-910459344786 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:15.898067 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e808de9c-1017-4caa-b23e-910459344786 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:15.906506 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-7b4b7ba2-93cd-456e-903a-79de7939b23f req-a4ae6a72-60e9-4bbe-a533-7a550d181baa service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:15.906977 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-7b4b7ba2-93cd-456e-903a-79de7939b23f req-a4ae6a72-60e9-4bbe-a533-7a550d181baa service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:15.907400 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-7b4b7ba2-93cd-456e-903a-79de7939b23f req-a4ae6a72-60e9-4bbe-a533-7a550d181baa service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:15.910929 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e808de9c-1017-4caa-b23e-910459344786 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:15.911410 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e808de9c-1017-4caa-b23e-910459344786 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:15.911840 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e808de9c-1017-4caa-b23e-910459344786 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:15.921508 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-7b4b7ba2-93cd-456e-903a-79de7939b23f req-a4ae6a72-60e9-4bbe-a533-7a550d181baa service nova] Creating event network-changed:efb966aa-2429-45da-a19d-e3445733bc00 for instance 79dc595d-ac88-4174-854c-cb2a8f0ea1c7 on hv-cinder-73306 Aug 08 02:46:15.927369 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-7b4b7ba2-93cd-456e-903a-79de7939b23f req-a4ae6a72-60e9-4bbe-a533-7a550d181baa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057667 Aug 08 02:46:15.928082 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 624/1258] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:46:15.938910 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e808de9c-1017-4caa-b23e-910459344786 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:46:16.021036 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e808de9c-1017-4caa-b23e-910459344786 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "DELETE /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 204 len: 0 microversion: 2.1 time: 0.153581 Aug 08 02:46:16.021943 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 635/1259] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:46:15 2022] DELETE /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:46:16.031126 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-65f74a9c-0f02-4a82-af86-f05357d58605 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:16.032221 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-65f74a9c-0f02-4a82-af86-f05357d58605 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:16.040291 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65f74a9c-0f02-4a82-af86-f05357d58605 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:16.040845 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65f74a9c-0f02-4a82-af86-f05357d58605 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:16.041346 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65f74a9c-0f02-4a82-af86-f05357d58605 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:16.042115 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65f74a9c-0f02-4a82-af86-f05357d58605 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:16.042689 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65f74a9c-0f02-4a82-af86-f05357d58605 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:16.043113 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65f74a9c-0f02-4a82-af86-f05357d58605 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:16.260900 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-65f74a9c-0f02-4a82-af86-f05357d58605 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:16.268583 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-65f74a9c-0f02-4a82-af86-f05357d58605 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1575 microversion: 2.1 time: 0.241842 Aug 08 02:46:16.269152 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 625/1260] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:16 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1575 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:17.289712 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-55e3fb24-b3ac-409a-b169-83e62140bc3b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:17.290209 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-55e3fb24-b3ac-409a-b169-83e62140bc3b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:17.297990 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55e3fb24-b3ac-409a-b169-83e62140bc3b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:17.298495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55e3fb24-b3ac-409a-b169-83e62140bc3b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:17.298929 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55e3fb24-b3ac-409a-b169-83e62140bc3b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:17.299623 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55e3fb24-b3ac-409a-b169-83e62140bc3b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:17.300080 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55e3fb24-b3ac-409a-b169-83e62140bc3b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:17.300502 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-55e3fb24-b3ac-409a-b169-83e62140bc3b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:17.305937 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [-] [014384fb-cbbd-4c9f-acee-c2152307a229] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 53604. Aug 08 02:46:17.485547 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-55e3fb24-b3ac-409a-b169-83e62140bc3b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:17.493680 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-55e3fb24-b3ac-409a-b169-83e62140bc3b tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1575 microversion: 2.1 time: 0.208448 Aug 08 02:46:17.494296 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 636/1261] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:17 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:18.407906 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-d0f5356b-1c0a-4abe-ac6f-a1181101ab1c req-29bfaa09-97bc-4962-9f31-4200c6cf1567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79dc595d-ac88-4174-854c-cb2a8f0ea1c7", "name": "network-vif-deleted", "tag": "efb966aa-2429-45da-a19d-e3445733bc00"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:46:18.426781 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] [db49a9c1-a60a-4eb6-bf29-211b2d41050f] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 53612. Aug 08 02:46:18.429704 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d0f5356b-1c0a-4abe-ac6f-a1181101ab1c req-29bfaa09-97bc-4962-9f31-4200c6cf1567 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:18.430181 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d0f5356b-1c0a-4abe-ac6f-a1181101ab1c req-29bfaa09-97bc-4962-9f31-4200c6cf1567 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:18.430761 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d0f5356b-1c0a-4abe-ac6f-a1181101ab1c req-29bfaa09-97bc-4962-9f31-4200c6cf1567 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:18.443943 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-d0f5356b-1c0a-4abe-ac6f-a1181101ab1c req-29bfaa09-97bc-4962-9f31-4200c6cf1567 service nova] Creating event network-vif-deleted:efb966aa-2429-45da-a19d-e3445733bc00 for instance 79dc595d-ac88-4174-854c-cb2a8f0ea1c7 on hv-cinder-73306 Aug 08 02:46:18.449022 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-d0f5356b-1c0a-4abe-ac6f-a1181101ab1c req-29bfaa09-97bc-4962-9f31-4200c6cf1567 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045463 Aug 08 02:46:18.449617 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 626/1262] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:46:18.515617 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-1a2e7752-804b-4523-b3d8-d0122521a92c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:18.516224 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-1a2e7752-804b-4523-b3d8-d0122521a92c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:18.523309 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a2e7752-804b-4523-b3d8-d0122521a92c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:18.523789 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a2e7752-804b-4523-b3d8-d0122521a92c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:18.524221 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a2e7752-804b-4523-b3d8-d0122521a92c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:18.524913 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a2e7752-804b-4523-b3d8-d0122521a92c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:18.525372 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a2e7752-804b-4523-b3d8-d0122521a92c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:18.525793 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-1a2e7752-804b-4523-b3d8-d0122521a92c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:18.589513 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-1a2e7752-804b-4523-b3d8-d0122521a92c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:18.597632 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-1a2e7752-804b-4523-b3d8-d0122521a92c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 200 len: 1224 microversion: 2.1 time: 0.086256 Aug 08 02:46:18.598194 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 637/1263] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:18 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:19.619212 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8209ac8a-f407-4db1-ae9f-585778c2011c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:19.619917 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8209ac8a-f407-4db1-ae9f-585778c2011c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 79dc595d-ac88-4174-854c-cb2a8f0ea1c7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:19.626595 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8209ac8a-f407-4db1-ae9f-585778c2011c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:19.627081 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8209ac8a-f407-4db1-ae9f-585778c2011c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:19.627518 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8209ac8a-f407-4db1-ae9f-585778c2011c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:19.628232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8209ac8a-f407-4db1-ae9f-585778c2011c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:19.628687 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8209ac8a-f407-4db1-ae9f-585778c2011c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:19.629111 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8209ac8a-f407-4db1-ae9f-585778c2011c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:19.642446 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-8209ac8a-f407-4db1-ae9f-585778c2011c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] HTTP exception thrown: Instance 79dc595d-ac88-4174-854c-cb2a8f0ea1c7 could not be found. Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8209ac8a-f407-4db1-ae9f-585778c2011c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Request method failure captured: Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 HTTP/1.1 Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HbnW1bKKkrNq6zEtQYhDDRJSfCqNxOxPICbvx5fP7MXfaBVmaM9VtIQcpaHIipyB9FapKtZtoeXEz3onz76-UFI25F82VpH4eCKFDk8__fhNHf_pPmAU3oUDmLTHzlp4sTHUIS-BZ8w0S4DuM0g2FEWqWP0A8Jacsd9bodf5lRf87U Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 7a06a8947bd84ac398bf498d8816717c Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:46:19.644068 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:46:19.645685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a06a8947bd84ac398bf498d8816717c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a06a8947bd84ac398bf498d8816717c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a06a8947bd84ac398bf498d8816717c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a06a8947bd84ac398bf498d8816717c"}]}] Aug 08 02:46:19.645685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:46:19.645685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 7a06a8947bd84ac398bf498d8816717c Aug 08 02:46:19.645685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:46:19.645685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-TestVolumeBootPattern-1786949426-project Aug 08 02:46:19.645685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:46:19.645685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:46:19.645685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 72485bc9ed6f4684b77b617597f99e29 Aug 08 02:46:19.645685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-TestVolumeBootPattern-1786949426-project Aug 08 02:46:19.645685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:46:19.645685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 79dc595d-ac88-4174-854c-cb2a8f0ea1c7 could not be found. Aug 08 02:46:19.645685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '79dc595d-ac88-4174-854c-cb2a8f0ea1c7'} Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79dc595d-ac88-4174-854c-cb2a8f0ea1c7 could not be found. Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:46:19.646655 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79dc595d-ac88-4174-854c-cb2a8f0ea1c7 could not be found. Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79dc595d-ac88-4174-854c-cb2a8f0ea1c7 could not be found. Aug 08 02:46:19.648300 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:19.649919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8209ac8a-f407-4db1-ae9f-585778c2011c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Returning 404 to user: Instance 79dc595d-ac88-4174-854c-cb2a8f0ea1c7 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:46:19.649919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8209ac8a-f407-4db1-ae9f-585778c2011c tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7" status: 404 len: 111 microversion: 2.1 time: 0.030476 Aug 08 02:46:19.649919 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 627/1264] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:19 2022] GET /compute/v2.1/servers/79dc595d-ac88-4174-854c-cb2a8f0ea1c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:46:22.695264 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-28bcc7ee-80ee-484d-965c-cda5cbe1cfbc tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:22.695768 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-28bcc7ee-80ee-484d-965c-cda5cbe1cfbc tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:22.702597 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-28bcc7ee-80ee-484d-965c-cda5cbe1cfbc tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:22.703078 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-28bcc7ee-80ee-484d-965c-cda5cbe1cfbc tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:22.703504 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-28bcc7ee-80ee-484d-965c-cda5cbe1cfbc tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:22.703724 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-83a1cebf-bcfc-42bf-9b9e-01ed60bded38 req-14637f0a-1769-47f8-a8d6-64ec89a38ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800f1d48-496a-4d2b-93b3-f9d65ae6e824", "tag": "a0d07287-712e-4449-a18d-cf15f3307426"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:46:22.704401 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-28bcc7ee-80ee-484d-965c-cda5cbe1cfbc tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:22.704964 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-28bcc7ee-80ee-484d-965c-cda5cbe1cfbc tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:22.705652 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-28bcc7ee-80ee-484d-965c-cda5cbe1cfbc tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:22.714552 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-83a1cebf-bcfc-42bf-9b9e-01ed60bded38 req-14637f0a-1769-47f8-a8d6-64ec89a38ba9 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:22.715031 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-83a1cebf-bcfc-42bf-9b9e-01ed60bded38 req-14637f0a-1769-47f8-a8d6-64ec89a38ba9 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:22.715457 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-83a1cebf-bcfc-42bf-9b9e-01ed60bded38 req-14637f0a-1769-47f8-a8d6-64ec89a38ba9 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:22.727131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-83a1cebf-bcfc-42bf-9b9e-01ed60bded38 req-14637f0a-1769-47f8-a8d6-64ec89a38ba9 service nova] Creating event network-changed:a0d07287-712e-4449-a18d-cf15f3307426 for instance 800f1d48-496a-4d2b-93b3-f9d65ae6e824 on hv-cinder-73306 Aug 08 02:46:22.732262 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-28bcc7ee-80ee-484d-965c-cda5cbe1cfbc tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Going to try to terminate instance {{(pid=117640) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:46:22.732457 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-83a1cebf-bcfc-42bf-9b9e-01ed60bded38 req-14637f0a-1769-47f8-a8d6-64ec89a38ba9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032251 Aug 08 02:46:22.733628 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 628/1265] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:46:22.820933 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-28bcc7ee-80ee-484d-965c-cda5cbe1cfbc tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "DELETE /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 204 len: 0 microversion: 2.1 time: 0.128557 Aug 08 02:46:22.822364 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 638/1266] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:46:22 2022] DELETE /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:46:22.830722 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a37f1f64-6eb2-4535-8852-426c177f05f5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:22.831820 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a37f1f64-6eb2-4535-8852-426c177f05f5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:22.838523 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a37f1f64-6eb2-4535-8852-426c177f05f5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:22.839032 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a37f1f64-6eb2-4535-8852-426c177f05f5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:22.839476 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a37f1f64-6eb2-4535-8852-426c177f05f5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:22.840192 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a37f1f64-6eb2-4535-8852-426c177f05f5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:22.840834 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a37f1f64-6eb2-4535-8852-426c177f05f5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:22.841258 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a37f1f64-6eb2-4535-8852-426c177f05f5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:22.977162 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a37f1f64-6eb2-4535-8852-426c177f05f5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:22.984736 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a37f1f64-6eb2-4535-8852-426c177f05f5 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1576 microversion: 2.1 time: 0.158292 Aug 08 02:46:22.985489 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 629/1267] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:22 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:24.007503 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d0cb4c0d-7586-400c-a867-75e9b6c1d8af tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:24.008200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d0cb4c0d-7586-400c-a867-75e9b6c1d8af tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:24.014569 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0cb4c0d-7586-400c-a867-75e9b6c1d8af tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:24.015042 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0cb4c0d-7586-400c-a867-75e9b6c1d8af tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:24.015467 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0cb4c0d-7586-400c-a867-75e9b6c1d8af tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:24.016141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0cb4c0d-7586-400c-a867-75e9b6c1d8af tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:24.016574 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0cb4c0d-7586-400c-a867-75e9b6c1d8af tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:24.016989 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d0cb4c0d-7586-400c-a867-75e9b6c1d8af tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:24.175289 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d0cb4c0d-7586-400c-a867-75e9b6c1d8af tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:24.182838 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d0cb4c0d-7586-400c-a867-75e9b6c1d8af tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1576 microversion: 2.1 time: 0.179580 Aug 08 02:46:24.183400 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 639/1268] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:24 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:25.149251 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-3bccccab-190c-49eb-be52-d20643322645 req-fa91e540-eb9e-46a8-8351-86f62b793163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800f1d48-496a-4d2b-93b3-f9d65ae6e824", "name": "network-vif-deleted", "tag": "a0d07287-712e-4449-a18d-cf15f3307426"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:46:25.160091 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-3bccccab-190c-49eb-be52-d20643322645 req-fa91e540-eb9e-46a8-8351-86f62b793163 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:25.160563 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-3bccccab-190c-49eb-be52-d20643322645 req-fa91e540-eb9e-46a8-8351-86f62b793163 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:25.160993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-3bccccab-190c-49eb-be52-d20643322645 req-fa91e540-eb9e-46a8-8351-86f62b793163 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:25.172011 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-3bccccab-190c-49eb-be52-d20643322645 req-fa91e540-eb9e-46a8-8351-86f62b793163 service nova] Creating event network-vif-deleted:a0d07287-712e-4449-a18d-cf15f3307426 for instance 800f1d48-496a-4d2b-93b3-f9d65ae6e824 on hv-cinder-73306 Aug 08 02:46:25.177711 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-3bccccab-190c-49eb-be52-d20643322645 req-fa91e540-eb9e-46a8-8351-86f62b793163 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Aug 08 02:46:25.178388 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 630/1269] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:46:25.203928 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-d104e3ba-7225-48c9-be61-d29e39a06dc6 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:25.204683 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-d104e3ba-7225-48c9-be61-d29e39a06dc6 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:25.211843 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d104e3ba-7225-48c9-be61-d29e39a06dc6 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:25.212326 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d104e3ba-7225-48c9-be61-d29e39a06dc6 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:25.212763 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d104e3ba-7225-48c9-be61-d29e39a06dc6 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:25.213466 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d104e3ba-7225-48c9-be61-d29e39a06dc6 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:25.213901 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d104e3ba-7225-48c9-be61-d29e39a06dc6 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:25.214351 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-d104e3ba-7225-48c9-be61-d29e39a06dc6 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:25.277208 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-d104e3ba-7225-48c9-be61-d29e39a06dc6 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72485bc9ed6f4684b77b617597f99e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a06a8947bd84ac398bf498d8816717c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:25.285397 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-d104e3ba-7225-48c9-be61-d29e39a06dc6 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 200 len: 1225 microversion: 2.1 time: 0.085521 Aug 08 02:46:25.285955 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 640/1270] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:25 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:26.307546 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4fed4240-ab10-435c-b4be-7050e6df6c98 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:26.308241 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4fed4240-ab10-435c-b4be-7050e6df6c98 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 800f1d48-496a-4d2b-93b3-f9d65ae6e824] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:26.314342 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fed4240-ab10-435c-b4be-7050e6df6c98 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:26.314816 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fed4240-ab10-435c-b4be-7050e6df6c98 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:26.315316 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fed4240-ab10-435c-b4be-7050e6df6c98 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:26.316292 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fed4240-ab10-435c-b4be-7050e6df6c98 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:26.316739 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fed4240-ab10-435c-b4be-7050e6df6c98 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:26.317158 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fed4240-ab10-435c-b4be-7050e6df6c98 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:26.330117 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-4fed4240-ab10-435c-b4be-7050e6df6c98 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] HTTP exception thrown: Instance 800f1d48-496a-4d2b-93b3-f9d65ae6e824 could not be found. Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4fed4240-ab10-435c-b4be-7050e6df6c98 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Request method failure captured: Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 HTTP/1.1 Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HbnW1bKKkrNq6zEtQYhDDRJSfCqNxOxPICbvx5fP7MXfaBVmaM9VtIQcpaHIipyB9FapKtZtoeXEz3onz76-UFI25F82VpH4eCKFDk8__fhNHf_pPmAU3oUDmLTHzlp4sTHUIS-BZ8w0S4DuM0g2FEWqWP0A8Jacsd9bodf5lRf87U Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 7a06a8947bd84ac398bf498d8816717c Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:46:26.331836 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:46:26.333589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a06a8947bd84ac398bf498d8816717c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a06a8947bd84ac398bf498d8816717c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a06a8947bd84ac398bf498d8816717c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a06a8947bd84ac398bf498d8816717c"}]}] Aug 08 02:46:26.333589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:46:26.333589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 7a06a8947bd84ac398bf498d8816717c Aug 08 02:46:26.333589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:46:26.333589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-TestVolumeBootPattern-1786949426-project Aug 08 02:46:26.333589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:46:26.333589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:46:26.333589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 72485bc9ed6f4684b77b617597f99e29 Aug 08 02:46:26.333589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-TestVolumeBootPattern-1786949426-project Aug 08 02:46:26.333589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:46:26.333589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 800f1d48-496a-4d2b-93b3-f9d65ae6e824 could not be found. Aug 08 02:46:26.333589 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '800f1d48-496a-4d2b-93b3-f9d65ae6e824'} Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800f1d48-496a-4d2b-93b3-f9d65ae6e824 could not be found. Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:46:26.334668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800f1d48-496a-4d2b-93b3-f9d65ae6e824 could not be found. Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800f1d48-496a-4d2b-93b3-f9d65ae6e824 could not be found. Aug 08 02:46:26.336249 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.337712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4fed4240-ab10-435c-b4be-7050e6df6c98 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Returning 404 to user: Instance 800f1d48-496a-4d2b-93b3-f9d65ae6e824 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:46:26.337712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4fed4240-ab10-435c-b4be-7050e6df6c98 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824" status: 404 len: 111 microversion: 2.1 time: 0.030504 Aug 08 02:46:26.337712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 631/1271] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:26 2022] GET /compute/v2.1/servers/800f1d48-496a-4d2b-93b3-f9d65ae6e824 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:46:26.804998 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-21987b43-4fc6-418c-ad14-8d4b45adecac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:26.805521 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-21987b43-4fc6-418c-ad14-8d4b45adecac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:26.812036 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-21987b43-4fc6-418c-ad14-8d4b45adecac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:26.812532 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-21987b43-4fc6-418c-ad14-8d4b45adecac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:26.812944 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-21987b43-4fc6-418c-ad14-8d4b45adecac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:26.813626 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-21987b43-4fc6-418c-ad14-8d4b45adecac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:26.814073 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-21987b43-4fc6-418c-ad14-8d4b45adecac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:26.814525 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-21987b43-4fc6-418c-ad14-8d4b45adecac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:26.828922 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-21987b43-4fc6-418c-ad14-8d4b45adecac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] HTTP exception thrown: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-21987b43-4fc6-418c-ad14-8d4b45adecac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Request method failure captured: Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: DELETE /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 HTTP/1.1 Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HbnW1bKKkrNq6zEtQYhDDRJSfCqNxOxPICbvx5fP7MXfaBVmaM9VtIQcpaHIipyB9FapKtZtoeXEz3onz76-UFI25F82VpH4eCKFDk8__fhNHf_pPmAU3oUDmLTHzlp4sTHUIS-BZ8w0S4DuM0g2FEWqWP0A8Jacsd9bodf5lRf87U Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 7a06a8947bd84ac398bf498d8816717c Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:46:26.830618 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:46:26.832792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a06a8947bd84ac398bf498d8816717c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a06a8947bd84ac398bf498d8816717c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a06a8947bd84ac398bf498d8816717c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a06a8947bd84ac398bf498d8816717c"}]}] Aug 08 02:46:26.832792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:46:26.832792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 7a06a8947bd84ac398bf498d8816717c Aug 08 02:46:26.832792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:46:26.832792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-TestVolumeBootPattern-1786949426-project Aug 08 02:46:26.832792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:46:26.832792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:46:26.832792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 72485bc9ed6f4684b77b617597f99e29 Aug 08 02:46:26.832792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-TestVolumeBootPattern-1786949426-project Aug 08 02:46:26.832792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:46:26.832792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:46:26.832792 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '7eee5906-f8e7-4294-8d31-0a12e9a69bb0'} Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:46:26.833909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:46:26.835540 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.837249 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-21987b43-4fc6-418c-ad14-8d4b45adecac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Returning 404 to user: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:46:26.837249 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-21987b43-4fc6-418c-ad14-8d4b45adecac tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 404 len: 111 microversion: 2.1 time: 0.031426 Aug 08 02:46:26.837249 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 641/1272] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:46:26 2022] DELETE /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:46:26.840933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c33bd177-0da7-48a8-bf5a-2952b2b1c4f3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:26.841545 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c33bd177-0da7-48a8-bf5a-2952b2b1c4f3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] [instance: 7eee5906-f8e7-4294-8d31-0a12e9a69bb0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:26.847932 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c33bd177-0da7-48a8-bf5a-2952b2b1c4f3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:26.848410 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c33bd177-0da7-48a8-bf5a-2952b2b1c4f3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:26.848852 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c33bd177-0da7-48a8-bf5a-2952b2b1c4f3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:26.849536 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c33bd177-0da7-48a8-bf5a-2952b2b1c4f3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:26.849988 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c33bd177-0da7-48a8-bf5a-2952b2b1c4f3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:26.850439 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c33bd177-0da7-48a8-bf5a-2952b2b1c4f3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:26.863491 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-c33bd177-0da7-48a8-bf5a-2952b2b1c4f3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] HTTP exception thrown: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c33bd177-0da7-48a8-bf5a-2952b2b1c4f3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Request method failure captured: Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 HTTP/1.1 Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept: application/json Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Connection: close Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Length: 0 Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Content-Type: application/json Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Host: 10.222.0.39 Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.11 Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABi8HbnW1bKKkrNq6zEtQYhDDRJSfCqNxOxPICbvx5fP7MXfaBVmaM9VtIQcpaHIipyB9FapKtZtoeXEz3onz76-UFI25F82VpH4eCKFDk8__fhNHf_pPmAU3oUDmLTHzlp4sTHUIS-BZ8w0S4DuM0g2FEWqWP0A8Jacsd9bodf5lRf87U Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Id: None Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Domain-Name: None Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Id: 7a06a8947bd84ac398bf498d8816717c Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Role: reader,member Aug 08 02:46:26.864980 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Roles: reader,member Aug 08 02:46:26.866670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a06a8947bd84ac398bf498d8816717c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a06a8947bd84ac398bf498d8816717c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a06a8947bd84ac398bf498d8816717c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a06a8947bd84ac398bf498d8816717c"}]}] Aug 08 02:46:26.866670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:46:26.866670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 7a06a8947bd84ac398bf498d8816717c Aug 08 02:46:26.866670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1786949426 Aug 08 02:46:26.866670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User: tempest-TestVolumeBootPattern-1786949426-project Aug 08 02:46:26.866670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default Aug 08 02:46:26.866670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default Aug 08 02:46:26.866670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Id: 72485bc9ed6f4684b77b617597f99e29 Aug 08 02:46:26.866670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-TestVolumeBootPattern-1786949426-project Aug 08 02:46:26.866670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: method: > Aug 08 02:46:26.866670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: exception: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:46:26.866670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: action_args: {'id': '7eee5906-f8e7-4294-8d31-0a12e9a69bb0'} Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:46:26.867783 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. Aug 08 02:46:26.869331 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Aug 08 02:46:26.870904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c33bd177-0da7-48a8-bf5a-2952b2b1c4f3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Returning 404 to user: Instance 7eee5906-f8e7-4294-8d31-0a12e9a69bb0 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:46:26.870904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c33bd177-0da7-48a8-bf5a-2952b2b1c4f3 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0" status: 404 len: 111 microversion: 2.1 time: 0.029184 Aug 08 02:46:26.870904 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 632/1273] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:26 2022] GET /compute/v2.1/servers/7eee5906-f8e7-4294-8d31-0a12e9a69bb0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:46:28.158125 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-a2d2e2a8-ab89-433b-be11-5f56ae518a50 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] Calling method '.version_select at 0x7f32950a79d0>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:28.183932 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-a2d2e2a8-ab89-433b-be11-5f56ae518a50 tempest-TestVolumeBootPattern-1786949426 tempest-TestVolumeBootPattern-1786949426-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-819876671" status: 202 len: 0 microversion: 2.1 time: 0.029476 Aug 08 02:46:28.184372 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 642/1274] 10.222.0.39 () {58 vars in 1260 bytes} [Mon Aug 8 02:46:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-819876671 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:46:52.348436 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cdfcdfd6-a1a1-4693-ba0f-c021d38e41d0 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:46:52.349015 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cdfcdfd6-a1a1-4693-ba0f-c021d38e41d0 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:52.351050 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=18 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:52.351810 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=26 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:52.357254 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdfcdfd6-a1a1-4693-ba0f-c021d38e41d0 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:52.357732 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdfcdfd6-a1a1-4693-ba0f-c021d38e41d0 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:52.358166 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdfcdfd6-a1a1-4693-ba0f-c021d38e41d0 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:52.358877 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdfcdfd6-a1a1-4693-ba0f-c021d38e41d0 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:52.359327 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdfcdfd6-a1a1-4693-ba0f-c021d38e41d0 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:52.359770 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cdfcdfd6-a1a1-4693-ba0f-c021d38e41d0 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:52.382526 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-cdfcdfd6-a1a1-4693-ba0f-c021d38e41d0 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lazy-loading 'flavor' on Instance uuid 59870f0a-23af-4ce5-ad4b-31164db7730b {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 02:46:52.458747 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cdfcdfd6-a1a1-4693-ba0f-c021d38e41d0 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "POST /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b/action" status: 202 len: 0 microversion: 2.1 time: 0.114727 Aug 08 02:46:52.459385 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 633/1275] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:46:52 2022] POST /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:46:52.468099 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-bb22b954-72e9-4d99-8c6c-b9bfbeb65f36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:52.469291 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-bb22b954-72e9-4d99-8c6c-b9bfbeb65f36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:52.472013 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:52.472714 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:46:52.480644 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bb22b954-72e9-4d99-8c6c-b9bfbeb65f36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:52.481361 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bb22b954-72e9-4d99-8c6c-b9bfbeb65f36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:52.481877 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bb22b954-72e9-4d99-8c6c-b9bfbeb65f36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:52.482687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bb22b954-72e9-4d99-8c6c-b9bfbeb65f36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:52.483201 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bb22b954-72e9-4d99-8c6c-b9bfbeb65f36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:52.483624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-bb22b954-72e9-4d99-8c6c-b9bfbeb65f36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:52.622526 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-bb22b954-72e9-4d99-8c6c-b9bfbeb65f36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:52.630128 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-bb22b954-72e9-4d99-8c6c-b9bfbeb65f36 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.166592 Aug 08 02:46:52.630723 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 643/1276] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:52 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:53.651782 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9a7e7594-71f2-4137-9843-60f2cdd366af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:53.652480 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9a7e7594-71f2-4137-9843-60f2cdd366af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:53.659128 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a7e7594-71f2-4137-9843-60f2cdd366af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:53.659604 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a7e7594-71f2-4137-9843-60f2cdd366af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:53.660035 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a7e7594-71f2-4137-9843-60f2cdd366af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:53.660716 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a7e7594-71f2-4137-9843-60f2cdd366af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:53.661162 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a7e7594-71f2-4137-9843-60f2cdd366af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:53.661584 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9a7e7594-71f2-4137-9843-60f2cdd366af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:53.792087 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9a7e7594-71f2-4137-9843-60f2cdd366af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:53.799976 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9a7e7594-71f2-4137-9843-60f2cdd366af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.152397 Aug 08 02:46:53.800534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 634/1277] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:53 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:54.821673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-788cbb28-3adb-47e0-9695-6f986ae7b826 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:54.822310 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-788cbb28-3adb-47e0-9695-6f986ae7b826 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:54.828804 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-788cbb28-3adb-47e0-9695-6f986ae7b826 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:54.829284 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-788cbb28-3adb-47e0-9695-6f986ae7b826 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:54.829719 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-788cbb28-3adb-47e0-9695-6f986ae7b826 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:54.831004 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-788cbb28-3adb-47e0-9695-6f986ae7b826 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:54.831492 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-788cbb28-3adb-47e0-9695-6f986ae7b826 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:54.831916 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-788cbb28-3adb-47e0-9695-6f986ae7b826 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:54.964875 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-788cbb28-3adb-47e0-9695-6f986ae7b826 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:54.972372 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-788cbb28-3adb-47e0-9695-6f986ae7b826 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.154620 Aug 08 02:46:54.972944 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 644/1278] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:54 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:55.993061 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3a70e4b4-7ce4-47fb-81a5-e1f8fc8ad43f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:55.993668 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3a70e4b4-7ce4-47fb-81a5-e1f8fc8ad43f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:56.000029 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a70e4b4-7ce4-47fb-81a5-e1f8fc8ad43f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:56.000504 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a70e4b4-7ce4-47fb-81a5-e1f8fc8ad43f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:56.000933 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a70e4b4-7ce4-47fb-81a5-e1f8fc8ad43f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:56.001656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a70e4b4-7ce4-47fb-81a5-e1f8fc8ad43f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:56.002200 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a70e4b4-7ce4-47fb-81a5-e1f8fc8ad43f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:56.002643 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a70e4b4-7ce4-47fb-81a5-e1f8fc8ad43f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:56.131685 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3a70e4b4-7ce4-47fb-81a5-e1f8fc8ad43f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:56.139023 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3a70e4b4-7ce4-47fb-81a5-e1f8fc8ad43f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.149814 Aug 08 02:46:56.139580 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 635/1279] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:55 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:57.161431 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-411cd521-308d-46d8-8b4c-56e5ea1d6805 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:57.162040 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-411cd521-308d-46d8-8b4c-56e5ea1d6805 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:57.168480 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-411cd521-308d-46d8-8b4c-56e5ea1d6805 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:57.168953 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-411cd521-308d-46d8-8b4c-56e5ea1d6805 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:57.169384 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-411cd521-308d-46d8-8b4c-56e5ea1d6805 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:57.170061 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-411cd521-308d-46d8-8b4c-56e5ea1d6805 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:57.170606 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-411cd521-308d-46d8-8b4c-56e5ea1d6805 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:57.171201 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-411cd521-308d-46d8-8b4c-56e5ea1d6805 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:57.302947 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-411cd521-308d-46d8-8b4c-56e5ea1d6805 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:57.310412 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-411cd521-308d-46d8-8b4c-56e5ea1d6805 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.153290 Aug 08 02:46:57.310974 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 645/1280] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:57 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:58.332246 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-937de50a-227b-49c9-a611-c35c2b92d307 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:58.332862 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-937de50a-227b-49c9-a611-c35c2b92d307 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:58.339532 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-937de50a-227b-49c9-a611-c35c2b92d307 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:58.340013 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-937de50a-227b-49c9-a611-c35c2b92d307 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:58.340446 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-937de50a-227b-49c9-a611-c35c2b92d307 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:58.341129 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-937de50a-227b-49c9-a611-c35c2b92d307 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:58.341580 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-937de50a-227b-49c9-a611-c35c2b92d307 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:58.342002 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-937de50a-227b-49c9-a611-c35c2b92d307 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:58.470664 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-937de50a-227b-49c9-a611-c35c2b92d307 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:58.478162 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-937de50a-227b-49c9-a611-c35c2b92d307 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.150314 Aug 08 02:46:58.478748 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 636/1281] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:58 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:46:59.498895 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-45e34e3f-f55d-4f1e-b515-46804dfff3e1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:46:59.499537 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-45e34e3f-f55d-4f1e-b515-46804dfff3e1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:46:59.505877 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-45e34e3f-f55d-4f1e-b515-46804dfff3e1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:59.506394 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-45e34e3f-f55d-4f1e-b515-46804dfff3e1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:59.506828 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-45e34e3f-f55d-4f1e-b515-46804dfff3e1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:59.507512 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-45e34e3f-f55d-4f1e-b515-46804dfff3e1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:46:59.507962 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-45e34e3f-f55d-4f1e-b515-46804dfff3e1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:46:59.508381 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-45e34e3f-f55d-4f1e-b515-46804dfff3e1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:46:59.636050 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-45e34e3f-f55d-4f1e-b515-46804dfff3e1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:46:59.643959 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-45e34e3f-f55d-4f1e-b515-46804dfff3e1 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.148901 Aug 08 02:46:59.644515 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 646/1282] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:46:59 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:00.665607 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5cfa7b3d-3612-4650-aeed-788a7a1eaa9f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:00.666222 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5cfa7b3d-3612-4650-aeed-788a7a1eaa9f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:00.672649 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cfa7b3d-3612-4650-aeed-788a7a1eaa9f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:00.673123 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cfa7b3d-3612-4650-aeed-788a7a1eaa9f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:00.673551 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cfa7b3d-3612-4650-aeed-788a7a1eaa9f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:00.674232 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cfa7b3d-3612-4650-aeed-788a7a1eaa9f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:00.674702 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cfa7b3d-3612-4650-aeed-788a7a1eaa9f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:00.675123 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5cfa7b3d-3612-4650-aeed-788a7a1eaa9f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:00.807756 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5cfa7b3d-3612-4650-aeed-788a7a1eaa9f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:00.816175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5cfa7b3d-3612-4650-aeed-788a7a1eaa9f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.154695 Aug 08 02:47:00.816820 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 637/1283] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:00 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:01.836861 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ed79d6bb-978f-49a2-94bc-1c62c59fd900 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:01.837468 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ed79d6bb-978f-49a2-94bc-1c62c59fd900 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:01.843829 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ed79d6bb-978f-49a2-94bc-1c62c59fd900 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:01.844300 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ed79d6bb-978f-49a2-94bc-1c62c59fd900 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:01.844754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ed79d6bb-978f-49a2-94bc-1c62c59fd900 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:01.846008 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ed79d6bb-978f-49a2-94bc-1c62c59fd900 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:01.846484 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ed79d6bb-978f-49a2-94bc-1c62c59fd900 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:01.846900 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ed79d6bb-978f-49a2-94bc-1c62c59fd900 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:01.980020 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ed79d6bb-978f-49a2-94bc-1c62c59fd900 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:01.987689 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ed79d6bb-978f-49a2-94bc-1c62c59fd900 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.154690 Aug 08 02:47:01.988239 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 647/1284] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:01 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:03.008584 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fca9c5a0-92f2-4a27-a7f3-6f5f311d279b tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:03.009200 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fca9c5a0-92f2-4a27-a7f3-6f5f311d279b tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:03.015677 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fca9c5a0-92f2-4a27-a7f3-6f5f311d279b tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:03.016157 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fca9c5a0-92f2-4a27-a7f3-6f5f311d279b tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:03.016592 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fca9c5a0-92f2-4a27-a7f3-6f5f311d279b tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:03.017986 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fca9c5a0-92f2-4a27-a7f3-6f5f311d279b tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:03.018642 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fca9c5a0-92f2-4a27-a7f3-6f5f311d279b tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:03.019235 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fca9c5a0-92f2-4a27-a7f3-6f5f311d279b tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:03.152975 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fca9c5a0-92f2-4a27-a7f3-6f5f311d279b tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:03.160458 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fca9c5a0-92f2-4a27-a7f3-6f5f311d279b tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.155741 Aug 08 02:47:03.161034 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 638/1285] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:03 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:04.181126 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-15fa499d-d6c6-4c3a-bc1c-bb5ca6d549de tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:04.181675 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-15fa499d-d6c6-4c3a-bc1c-bb5ca6d549de tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:04.188140 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-15fa499d-d6c6-4c3a-bc1c-bb5ca6d549de tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:04.188615 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-15fa499d-d6c6-4c3a-bc1c-bb5ca6d549de tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:04.189614 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-15fa499d-d6c6-4c3a-bc1c-bb5ca6d549de tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:04.190314 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-15fa499d-d6c6-4c3a-bc1c-bb5ca6d549de tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:04.191030 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-15fa499d-d6c6-4c3a-bc1c-bb5ca6d549de tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:04.191450 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-15fa499d-d6c6-4c3a-bc1c-bb5ca6d549de tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:04.321513 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-15fa499d-d6c6-4c3a-bc1c-bb5ca6d549de tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:04.329126 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-15fa499d-d6c6-4c3a-bc1c-bb5ca6d549de tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.151999 Aug 08 02:47:04.329725 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 648/1286] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:04 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:05.350234 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0f15aaf3-2b4f-4546-ba60-8b4a48ba8ef3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:05.350859 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0f15aaf3-2b4f-4546-ba60-8b4a48ba8ef3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:05.357351 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f15aaf3-2b4f-4546-ba60-8b4a48ba8ef3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:05.357835 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f15aaf3-2b4f-4546-ba60-8b4a48ba8ef3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:05.358290 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f15aaf3-2b4f-4546-ba60-8b4a48ba8ef3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:05.358994 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f15aaf3-2b4f-4546-ba60-8b4a48ba8ef3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:05.359445 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f15aaf3-2b4f-4546-ba60-8b4a48ba8ef3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:05.359866 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f15aaf3-2b4f-4546-ba60-8b4a48ba8ef3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:05.499013 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0f15aaf3-2b4f-4546-ba60-8b4a48ba8ef3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:05.506602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0f15aaf3-2b4f-4546-ba60-8b4a48ba8ef3 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1570 microversion: 2.1 time: 0.160396 Aug 08 02:47:05.507192 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 639/1287] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:05 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:05.529336 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-5a3cb861-502e-44c3-99fa-b91adb136d65 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:47:05.529917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5a3cb861-502e-44c3-99fa-b91adb136d65 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:05.536994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a3cb861-502e-44c3-99fa-b91adb136d65 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:05.537819 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a3cb861-502e-44c3-99fa-b91adb136d65 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:05.538328 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a3cb861-502e-44c3-99fa-b91adb136d65 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:05.539269 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a3cb861-502e-44c3-99fa-b91adb136d65 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:05.539717 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a3cb861-502e-44c3-99fa-b91adb136d65 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:05.540141 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-5a3cb861-502e-44c3-99fa-b91adb136d65 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:05.586997 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-5a3cb861-502e-44c3-99fa-b91adb136d65 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117640) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 02:47:05.651243 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5a3cb861-502e-44c3-99fa-b91adb136d65 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [323b223c-9852-4131-9c3d-973353f290db] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 02:47:06.658503 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [None req-5a3cb861-502e-44c3-99fa-b91adb136d65 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [323b223c-9852-4131-9c3d-973353f290db] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 53742. Aug 08 02:47:06.661463 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-5a3cb861-502e-44c3-99fa-b91adb136d65 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "POST /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b/action" status: 202 len: 0 microversion: 2.1 time: 1.136825 Aug 08 02:47:06.662070 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 649/1288] 10.222.0.39 () {60 vars in 1278 bytes} [Mon Aug 8 02:47:05 2022] POST /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b/action => generated 0 bytes in 1138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:47:06.670130 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-95e37008-cfaa-46ae-a507-0d3595e453be tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:06.670804 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-95e37008-cfaa-46ae-a507-0d3595e453be tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:06.677116 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95e37008-cfaa-46ae-a507-0d3595e453be tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:06.677594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95e37008-cfaa-46ae-a507-0d3595e453be tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:06.678029 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95e37008-cfaa-46ae-a507-0d3595e453be tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:06.678763 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95e37008-cfaa-46ae-a507-0d3595e453be tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:06.679200 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95e37008-cfaa-46ae-a507-0d3595e453be tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:06.679614 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95e37008-cfaa-46ae-a507-0d3595e453be tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:06.818594 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-95e37008-cfaa-46ae-a507-0d3595e453be tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:06.826018 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-95e37008-cfaa-46ae-a507-0d3595e453be tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1518 microversion: 2.1 time: 0.159704 Aug 08 02:47:06.826619 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 640/1289] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:06 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:07.521191 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-2274cdf6-69f2-4f1e-8e2d-c55153bcf69c req-4fb73392-8cf8-42ef-9ea0-44a9ed5cce58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59870f0a-23af-4ce5-ad4b-31164db7730b", "name": "network-vif-unplugged", "status": "completed", "tag": "55d4bd39-d798-4f0b-b93f-f29df0ceaecf"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:47:07.531209 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-2274cdf6-69f2-4f1e-8e2d-c55153bcf69c req-4fb73392-8cf8-42ef-9ea0-44a9ed5cce58 service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:07.531673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-2274cdf6-69f2-4f1e-8e2d-c55153bcf69c req-4fb73392-8cf8-42ef-9ea0-44a9ed5cce58 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:07.532092 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-2274cdf6-69f2-4f1e-8e2d-c55153bcf69c req-4fb73392-8cf8-42ef-9ea0-44a9ed5cce58 service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:07.542545 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.compute.server_external_events [req-2274cdf6-69f2-4f1e-8e2d-c55153bcf69c req-4fb73392-8cf8-42ef-9ea0-44a9ed5cce58 service nova] Unable to find a host for instance 59870f0a-23af-4ce5-ad4b-31164db7730b. Dropping event network-vif-unplugged {{(pid=117640) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 08 02:47:07.543383 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-2274cdf6-69f2-4f1e-8e2d-c55153bcf69c req-4fb73392-8cf8-42ef-9ea0-44a9ed5cce58 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.143196 Aug 08 02:47:07.543928 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 650/1290] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 144 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 08 02:47:07.847929 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-db5e48c3-9dd9-464c-b62a-6fd40166d75a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:07.848540 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-db5e48c3-9dd9-464c-b62a-6fd40166d75a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:07.854798 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db5e48c3-9dd9-464c-b62a-6fd40166d75a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:07.855274 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db5e48c3-9dd9-464c-b62a-6fd40166d75a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:07.855698 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db5e48c3-9dd9-464c-b62a-6fd40166d75a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:07.856380 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db5e48c3-9dd9-464c-b62a-6fd40166d75a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:07.856822 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db5e48c3-9dd9-464c-b62a-6fd40166d75a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:07.857237 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db5e48c3-9dd9-464c-b62a-6fd40166d75a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:08.004318 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-db5e48c3-9dd9-464c-b62a-6fd40166d75a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:08.012535 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-db5e48c3-9dd9-464c-b62a-6fd40166d75a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1518 microversion: 2.1 time: 0.169169 Aug 08 02:47:08.013090 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 641/1291] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:07 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:09.033097 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-2b6edbbd-962d-4ff4-a921-858066afc53a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:09.033708 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-2b6edbbd-962d-4ff4-a921-858066afc53a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:09.040037 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b6edbbd-962d-4ff4-a921-858066afc53a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:09.040495 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b6edbbd-962d-4ff4-a921-858066afc53a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:09.040920 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b6edbbd-962d-4ff4-a921-858066afc53a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:09.041602 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b6edbbd-962d-4ff4-a921-858066afc53a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:09.042043 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b6edbbd-962d-4ff4-a921-858066afc53a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:09.042480 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-2b6edbbd-962d-4ff4-a921-858066afc53a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:09.189423 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-2b6edbbd-962d-4ff4-a921-858066afc53a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:09.197170 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-2b6edbbd-962d-4ff4-a921-858066afc53a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1518 microversion: 2.1 time: 0.167993 Aug 08 02:47:09.197727 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 651/1292] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:09 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:10.218470 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d528e6d2-d692-4fdf-b4f1-99721342cb03 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:10.219064 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d528e6d2-d692-4fdf-b4f1-99721342cb03 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:10.226793 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d528e6d2-d692-4fdf-b4f1-99721342cb03 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:10.227327 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d528e6d2-d692-4fdf-b4f1-99721342cb03 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:10.227944 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d528e6d2-d692-4fdf-b4f1-99721342cb03 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:10.228647 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d528e6d2-d692-4fdf-b4f1-99721342cb03 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:10.229101 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d528e6d2-d692-4fdf-b4f1-99721342cb03 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:10.229520 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d528e6d2-d692-4fdf-b4f1-99721342cb03 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:10.368002 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d528e6d2-d692-4fdf-b4f1-99721342cb03 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:10.375510 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d528e6d2-d692-4fdf-b4f1-99721342cb03 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1518 microversion: 2.1 time: 0.160989 Aug 08 02:47:10.376059 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 642/1293] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:10 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:11.396766 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-b782c298-7f50-4c45-a36b-e3863bdafbcd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:11.397406 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-b782c298-7f50-4c45-a36b-e3863bdafbcd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:11.403849 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b782c298-7f50-4c45-a36b-e3863bdafbcd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:11.404324 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b782c298-7f50-4c45-a36b-e3863bdafbcd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:11.404754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b782c298-7f50-4c45-a36b-e3863bdafbcd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:11.405432 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b782c298-7f50-4c45-a36b-e3863bdafbcd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:11.405885 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b782c298-7f50-4c45-a36b-e3863bdafbcd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:11.406337 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-b782c298-7f50-4c45-a36b-e3863bdafbcd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:11.606295 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-b782c298-7f50-4c45-a36b-e3863bdafbcd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:11.613781 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-b782c298-7f50-4c45-a36b-e3863bdafbcd tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1576 microversion: 2.1 time: 0.220896 Aug 08 02:47:11.614370 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 652/1294] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:11 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:12.635141 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-73e87b78-cfdc-484d-b13a-6473219313ac tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:12.635677 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-73e87b78-cfdc-484d-b13a-6473219313ac tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:12.641970 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73e87b78-cfdc-484d-b13a-6473219313ac tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:12.642470 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73e87b78-cfdc-484d-b13a-6473219313ac tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:12.642899 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73e87b78-cfdc-484d-b13a-6473219313ac tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:12.643572 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73e87b78-cfdc-484d-b13a-6473219313ac tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:12.644012 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73e87b78-cfdc-484d-b13a-6473219313ac tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:12.644425 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-73e87b78-cfdc-484d-b13a-6473219313ac tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:12.778641 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-73e87b78-cfdc-484d-b13a-6473219313ac tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:12.786656 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-73e87b78-cfdc-484d-b13a-6473219313ac tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1576 microversion: 2.1 time: 0.155354 Aug 08 02:47:12.787239 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 643/1295] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:12 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:13.808139 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-ecddeb0e-12d2-448d-96f3-01c085cd070a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:13.808754 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-ecddeb0e-12d2-448d-96f3-01c085cd070a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:13.815273 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ecddeb0e-12d2-448d-96f3-01c085cd070a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:13.816025 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ecddeb0e-12d2-448d-96f3-01c085cd070a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:13.816452 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ecddeb0e-12d2-448d-96f3-01c085cd070a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:13.817132 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ecddeb0e-12d2-448d-96f3-01c085cd070a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:13.817577 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ecddeb0e-12d2-448d-96f3-01c085cd070a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:13.818000 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-ecddeb0e-12d2-448d-96f3-01c085cd070a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:13.946443 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-ecddeb0e-12d2-448d-96f3-01c085cd070a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:13.953812 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-ecddeb0e-12d2-448d-96f3-01c085cd070a tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1576 microversion: 2.1 time: 0.149497 Aug 08 02:47:13.954893 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 653/1296] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:13 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:14.975992 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d13d4d2f-1c45-4515-9a91-d55419d312dc tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:14.976602 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d13d4d2f-1c45-4515-9a91-d55419d312dc tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:14.983085 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d13d4d2f-1c45-4515-9a91-d55419d312dc tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:14.983561 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d13d4d2f-1c45-4515-9a91-d55419d312dc tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:14.983993 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d13d4d2f-1c45-4515-9a91-d55419d312dc tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:14.984671 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d13d4d2f-1c45-4515-9a91-d55419d312dc tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:14.985118 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d13d4d2f-1c45-4515-9a91-d55419d312dc tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:14.986131 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d13d4d2f-1c45-4515-9a91-d55419d312dc tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:15.114841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d13d4d2f-1c45-4515-9a91-d55419d312dc tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:15.122197 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d13d4d2f-1c45-4515-9a91-d55419d312dc tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1576 microversion: 2.1 time: 0.150034 Aug 08 02:47:15.122787 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 644/1297] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:14 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:16.143055 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3c7acdb0-1cc5-4522-9fb4-0b52a50a3871 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:16.143661 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3c7acdb0-1cc5-4522-9fb4-0b52a50a3871 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:16.150167 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c7acdb0-1cc5-4522-9fb4-0b52a50a3871 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:16.150662 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c7acdb0-1cc5-4522-9fb4-0b52a50a3871 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:16.151088 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c7acdb0-1cc5-4522-9fb4-0b52a50a3871 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:16.151762 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c7acdb0-1cc5-4522-9fb4-0b52a50a3871 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:16.152202 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c7acdb0-1cc5-4522-9fb4-0b52a50a3871 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:16.152613 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3c7acdb0-1cc5-4522-9fb4-0b52a50a3871 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:16.281441 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3c7acdb0-1cc5-4522-9fb4-0b52a50a3871 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:16.288892 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3c7acdb0-1cc5-4522-9fb4-0b52a50a3871 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1576 microversion: 2.1 time: 0.149817 Aug 08 02:47:16.289452 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 654/1298] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:16 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:17.310043 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-425348f4-dbf6-43e5-8631-98c3e9f63911 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:17.310712 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-425348f4-dbf6-43e5-8631-98c3e9f63911 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:17.317934 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-425348f4-dbf6-43e5-8631-98c3e9f63911 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:17.318452 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-425348f4-dbf6-43e5-8631-98c3e9f63911 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:17.318892 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-425348f4-dbf6-43e5-8631-98c3e9f63911 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:17.319582 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-425348f4-dbf6-43e5-8631-98c3e9f63911 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:17.320036 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-425348f4-dbf6-43e5-8631-98c3e9f63911 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:17.320461 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-425348f4-dbf6-43e5-8631-98c3e9f63911 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:17.449096 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-425348f4-dbf6-43e5-8631-98c3e9f63911 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:17.457477 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-425348f4-dbf6-43e5-8631-98c3e9f63911 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1576 microversion: 2.1 time: 0.151251 Aug 08 02:47:17.458057 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 645/1299] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:17 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:18.478509 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-928a3267-e920-4d6a-97a5-cff2512433d8 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:18.479121 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-928a3267-e920-4d6a-97a5-cff2512433d8 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:18.485233 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-928a3267-e920-4d6a-97a5-cff2512433d8 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:18.485755 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-928a3267-e920-4d6a-97a5-cff2512433d8 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:18.486185 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-928a3267-e920-4d6a-97a5-cff2512433d8 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:18.486900 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-928a3267-e920-4d6a-97a5-cff2512433d8 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:18.487350 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-928a3267-e920-4d6a-97a5-cff2512433d8 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:18.487772 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-928a3267-e920-4d6a-97a5-cff2512433d8 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:18.618613 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-928a3267-e920-4d6a-97a5-cff2512433d8 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:18.626672 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-928a3267-e920-4d6a-97a5-cff2512433d8 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1576 microversion: 2.1 time: 0.151524 Aug 08 02:47:18.627238 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 655/1300] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:18 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:19.647909 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6044caba-2a16-414f-99be-7dce2ffc715f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:19.648450 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6044caba-2a16-414f-99be-7dce2ffc715f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:19.654351 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6044caba-2a16-414f-99be-7dce2ffc715f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:19.654825 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6044caba-2a16-414f-99be-7dce2ffc715f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:19.655251 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6044caba-2a16-414f-99be-7dce2ffc715f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:19.655925 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6044caba-2a16-414f-99be-7dce2ffc715f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:19.656368 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6044caba-2a16-414f-99be-7dce2ffc715f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:19.656784 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6044caba-2a16-414f-99be-7dce2ffc715f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:19.791938 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6044caba-2a16-414f-99be-7dce2ffc715f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:19.800818 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6044caba-2a16-414f-99be-7dce2ffc715f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1576 microversion: 2.1 time: 0.156996 Aug 08 02:47:19.801392 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 646/1301] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:19 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:20.822177 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-7f62b9ca-ec7e-4482-81e4-e398153db69c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:20.822822 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-7f62b9ca-ec7e-4482-81e4-e398153db69c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:20.829636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7f62b9ca-ec7e-4482-81e4-e398153db69c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:20.830112 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7f62b9ca-ec7e-4482-81e4-e398153db69c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:20.830575 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7f62b9ca-ec7e-4482-81e4-e398153db69c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:20.831259 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7f62b9ca-ec7e-4482-81e4-e398153db69c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:20.831710 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7f62b9ca-ec7e-4482-81e4-e398153db69c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:20.832127 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-7f62b9ca-ec7e-4482-81e4-e398153db69c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:20.962392 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-7f62b9ca-ec7e-4482-81e4-e398153db69c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:20.970411 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-7f62b9ca-ec7e-4482-81e4-e398153db69c tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1576 microversion: 2.1 time: 0.151986 Aug 08 02:47:20.970969 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 656/1302] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:20 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:21.520872 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-8db9df49-e651-4dfc-b44a-3811d0d08b7d req-e8474d84-cf80-4b5d-bda2-ce6a3f22b0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59870f0a-23af-4ce5-ad4b-31164db7730b", "name": "network-vif-plugged", "status": "completed", "tag": "55d4bd39-d798-4f0b-b93f-f29df0ceaecf"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:47:21.531534 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-8db9df49-e651-4dfc-b44a-3811d0d08b7d req-e8474d84-cf80-4b5d-bda2-ce6a3f22b0ba service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:21.532005 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-8db9df49-e651-4dfc-b44a-3811d0d08b7d req-e8474d84-cf80-4b5d-bda2-ce6a3f22b0ba service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:21.533027 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-8db9df49-e651-4dfc-b44a-3811d0d08b7d req-e8474d84-cf80-4b5d-bda2-ce6a3f22b0ba service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:21.544428 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-8db9df49-e651-4dfc-b44a-3811d0d08b7d req-e8474d84-cf80-4b5d-bda2-ce6a3f22b0ba service nova] Creating event network-vif-plugged:55d4bd39-d798-4f0b-b93f-f29df0ceaecf for instance 59870f0a-23af-4ce5-ad4b-31164db7730b on hv-cinder-73306 Aug 08 02:47:21.549519 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-8db9df49-e651-4dfc-b44a-3811d0d08b7d req-e8474d84-cf80-4b5d-bda2-ce6a3f22b0ba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032744 Aug 08 02:47:21.550144 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 647/1303] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 02:47:21.991292 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-3fbb9f61-b544-4397-857e-1ee9197b04ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:21.991830 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-3fbb9f61-b544-4397-857e-1ee9197b04ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:21.998174 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3fbb9f61-b544-4397-857e-1ee9197b04ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:21.998687 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3fbb9f61-b544-4397-857e-1ee9197b04ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:21.999117 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3fbb9f61-b544-4397-857e-1ee9197b04ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:21.999788 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3fbb9f61-b544-4397-857e-1ee9197b04ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:22.000231 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3fbb9f61-b544-4397-857e-1ee9197b04ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:22.000643 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-3fbb9f61-b544-4397-857e-1ee9197b04ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:22.128339 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-3fbb9f61-b544-4397-857e-1ee9197b04ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:22.135779 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-3fbb9f61-b544-4397-857e-1ee9197b04ed tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1576 microversion: 2.1 time: 0.148289 Aug 08 02:47:22.136323 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 657/1304] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:21 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:23.157678 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-99ee2c11-c13b-4ec9-a107-a226b66194af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:23.158403 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-99ee2c11-c13b-4ec9-a107-a226b66194af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:23.160312 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=31 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:47:23.166007 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99ee2c11-c13b-4ec9-a107-a226b66194af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:23.166510 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99ee2c11-c13b-4ec9-a107-a226b66194af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:23.166945 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99ee2c11-c13b-4ec9-a107-a226b66194af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:23.167628 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99ee2c11-c13b-4ec9-a107-a226b66194af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:23.168081 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99ee2c11-c13b-4ec9-a107-a226b66194af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:23.168498 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-99ee2c11-c13b-4ec9-a107-a226b66194af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:23.172335 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:47:23.301267 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-99ee2c11-c13b-4ec9-a107-a226b66194af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:23.308772 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-99ee2c11-c13b-4ec9-a107-a226b66194af tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1576 microversion: 2.1 time: 0.155838 Aug 08 02:47:23.309342 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 648/1305] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:23 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:47:23.532167 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:47:23.532429 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Mon Aug 8 02:47:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:47:24.331398 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-e80a511f-a795-4093-8a70-adb27083b524 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:47:24.332010 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-e80a511f-a795-4093-8a70-adb27083b524 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:47:24.334310 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:47:24.340108 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e80a511f-a795-4093-8a70-adb27083b524 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:24.340624 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e80a511f-a795-4093-8a70-adb27083b524 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:24.341054 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e80a511f-a795-4093-8a70-adb27083b524 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:24.341731 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e80a511f-a795-4093-8a70-adb27083b524 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:47:24.342172 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e80a511f-a795-4093-8a70-adb27083b524 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:47:24.342620 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-e80a511f-a795-4093-8a70-adb27083b524 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:47:24.347805 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:47:24.474137 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-e80a511f-a795-4093-8a70-adb27083b524 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:47:24.481641 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-e80a511f-a795-4093-8a70-adb27083b524 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1563 microversion: 2.1 time: 0.154628 Aug 08 02:47:24.482233 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 658/1306] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:47:24 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:48:56.007984 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:48:56.008449 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Mon Aug 8 02:48:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:48:56.940810 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:48:56.941568 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Mon Aug 8 02:48:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:49:00.412958 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:49:00.413903 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=5 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:49:00.418605 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-41d47d9d-684e-4ec5-89c3-785465a3291e tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:49:00.419277 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-41d47d9d-684e-4ec5-89c3-785465a3291e tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:49:00.424552 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_api:SELECT=1 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:49:00.426547 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG dbcounter [-] [117640] Writing DB stats nova_cell1:SELECT=5 {{(pid=117640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 02:49:00.426930 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d47d9d-684e-4ec5-89c3-785465a3291e tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:00.427794 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d47d9d-684e-4ec5-89c3-785465a3291e tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:00.428235 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d47d9d-684e-4ec5-89c3-785465a3291e tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:00.429306 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d47d9d-684e-4ec5-89c3-785465a3291e tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:00.429407 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d47d9d-684e-4ec5-89c3-785465a3291e tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:00.429897 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41d47d9d-684e-4ec5-89c3-785465a3291e tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:00.458276 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-41d47d9d-684e-4ec5-89c3-785465a3291e tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 02:49:00.484676 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [req-34211c26-ae03-4d7d-a161-1b50a72e4a48 req-e315f718-8c10-4301-b1bc-d5fbc151f01e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59870f0a-23af-4ce5-ad4b-31164db7730b", "tag": "55d4bd39-d798-4f0b-b93f-f29df0ceaecf"}]} {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:49:00.495987 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-34211c26-ae03-4d7d-a161-1b50a72e4a48 req-e315f718-8c10-4301-b1bc-d5fbc151f01e service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:00.496462 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-34211c26-ae03-4d7d-a161-1b50a72e4a48 req-e315f718-8c10-4301-b1bc-d5fbc151f01e service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:00.496979 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [req-34211c26-ae03-4d7d-a161-1b50a72e4a48 req-e315f718-8c10-4301-b1bc-d5fbc151f01e service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:00.509298 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.compute.server_external_events [req-34211c26-ae03-4d7d-a161-1b50a72e4a48 req-e315f718-8c10-4301-b1bc-d5fbc151f01e service nova] Creating event network-changed:55d4bd39-d798-4f0b-b93f-f29df0ceaecf for instance 59870f0a-23af-4ce5-ad4b-31164db7730b on hv-cinder-73306 Aug 08 02:49:00.512863 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR oslo.messaging._drivers.impl_rabbit [req-34211c26-ae03-4d7d-a161-1b50a72e4a48 req-e315f718-8c10-4301-b1bc-d5fbc151f01e service nova] [e3fd8e7b-049a-497a-b206-d8093138b388] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 02:49:00.547083 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-41d47d9d-684e-4ec5-89c3-785465a3291e tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "DELETE /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 204 len: 0 microversion: 2.1 time: 0.135445 Aug 08 02:49:00.548218 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 649/1307] 10.222.0.39 () {58 vars in 1239 bytes} [Mon Aug 8 02:49:00 2022] DELETE /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 02:49:00.557550 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-264b5799-e1b3-4ba4-a2e3-42dcff0dfe04 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:49:00.558280 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-264b5799-e1b3-4ba4-a2e3-42dcff0dfe04 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:49:00.564644 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-264b5799-e1b3-4ba4-a2e3-42dcff0dfe04 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:00.565124 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-264b5799-e1b3-4ba4-a2e3-42dcff0dfe04 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:00.565841 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-264b5799-e1b3-4ba4-a2e3-42dcff0dfe04 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:00.566580 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-264b5799-e1b3-4ba4-a2e3-42dcff0dfe04 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:00.567025 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-264b5799-e1b3-4ba4-a2e3-42dcff0dfe04 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:00.567438 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-264b5799-e1b3-4ba4-a2e3-42dcff0dfe04 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:00.703891 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-264b5799-e1b3-4ba4-a2e3-42dcff0dfe04 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:49:00.712139 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-264b5799-e1b3-4ba4-a2e3-42dcff0dfe04 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.158965 Aug 08 02:49:00.712713 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 650/1308] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:49:00 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 02:49:01.519636 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [req-34211c26-ae03-4d7d-a161-1b50a72e4a48 req-e315f718-8c10-4301-b1bc-d5fbc151f01e service nova] [e3fd8e7b-049a-497a-b206-d8093138b388] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 53852. Aug 08 02:49:01.523113 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [req-34211c26-ae03-4d7d-a161-1b50a72e4a48 req-e315f718-8c10-4301-b1bc-d5fbc151f01e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.104472 Aug 08 02:49:01.523718 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 659/1309] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:49:01.732964 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cb685c81-b629-4f4e-885b-7d0908421f37 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:49:01.733585 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cb685c81-b629-4f4e-885b-7d0908421f37 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:49:01.740677 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb685c81-b629-4f4e-885b-7d0908421f37 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:01.741190 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb685c81-b629-4f4e-885b-7d0908421f37 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:01.741769 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb685c81-b629-4f4e-885b-7d0908421f37 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:01.742675 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb685c81-b629-4f4e-885b-7d0908421f37 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:01.743132 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb685c81-b629-4f4e-885b-7d0908421f37 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:01.743558 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb685c81-b629-4f4e-885b-7d0908421f37 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:01.873752 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cb685c81-b629-4f4e-885b-7d0908421f37 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:49:01.883175 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cb685c81-b629-4f4e-885b-7d0908421f37 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1569 microversion: 2.1 time: 0.154007 Aug 08 02:49:01.889570 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 651/1310] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:49:01 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:49:02.905889 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-170ff8b6-1e28-4f13-aa33-27263e87a082 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:49:02.906633 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-170ff8b6-1e28-4f13-aa33-27263e87a082 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:49:02.913977 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-170ff8b6-1e28-4f13-aa33-27263e87a082 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:02.914488 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-170ff8b6-1e28-4f13-aa33-27263e87a082 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:02.914917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-170ff8b6-1e28-4f13-aa33-27263e87a082 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:02.915600 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-170ff8b6-1e28-4f13-aa33-27263e87a082 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:02.916116 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-170ff8b6-1e28-4f13-aa33-27263e87a082 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:02.916526 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-170ff8b6-1e28-4f13-aa33-27263e87a082 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:02.985461 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.policy [None req-170ff8b6-1e28-4f13-aa33-27263e87a082 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd48dc29f945b9873334293d85b783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94219d4e012248139b9df01bcdf39bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117640) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 02:49:02.994019 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-42a0e1e9-143a-45b4-b3a6-015107743682 req-e4c15564-75fe-4dae-942f-e301b95d493c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59870f0a-23af-4ce5-ad4b-31164db7730b", "name": "network-vif-deleted", "tag": "55d4bd39-d798-4f0b-b93f-f29df0ceaecf"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 02:49:03.002839 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-170ff8b6-1e28-4f13-aa33-27263e87a082 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 200 len: 1382 microversion: 2.1 time: 0.101538 Aug 08 02:49:03.003968 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 660/1311] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:49:02 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 1382 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 02:49:03.004891 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-42a0e1e9-143a-45b4-b3a6-015107743682 req-e4c15564-75fe-4dae-942f-e301b95d493c service nova] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:03.005610 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-42a0e1e9-143a-45b4-b3a6-015107743682 req-e4c15564-75fe-4dae-942f-e301b95d493c service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:03.006087 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-42a0e1e9-143a-45b4-b3a6-015107743682 req-e4c15564-75fe-4dae-942f-e301b95d493c service nova] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:03.017435 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-42a0e1e9-143a-45b4-b3a6-015107743682 req-e4c15564-75fe-4dae-942f-e301b95d493c service nova] Creating event network-vif-deleted:55d4bd39-d798-4f0b-b93f-f29df0ceaecf for instance 59870f0a-23af-4ce5-ad4b-31164db7730b on hv-cinder-73306 Aug 08 02:49:03.022731 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-42a0e1e9-143a-45b4-b3a6-015107743682 req-e4c15564-75fe-4dae-942f-e301b95d493c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100561 Aug 08 02:49:03.023316 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 652/1312] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Aug 8 02:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 02:49:04.025150 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dfab3d10-0763-4607-bd38-e5318f54074f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '>' {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:49:04.025763 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.compute.api [None req-dfab3d10-0763-4607-bd38-e5318f54074f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] [instance: 59870f0a-23af-4ce5-ad4b-31164db7730b] Fetching instance by UUID {{(pid=117640) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 02:49:04.032200 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfab3d10-0763-4607-bd38-e5318f54074f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:04.032673 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfab3d10-0763-4607-bd38-e5318f54074f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:04.033105 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfab3d10-0763-4607-bd38-e5318f54074f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:04.033783 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfab3d10-0763-4607-bd38-e5318f54074f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Acquiring lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 02:49:04.034878 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfab3d10-0763-4607-bd38-e5318f54074f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 02:49:04.035306 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG oslo_concurrency.lockutils [None req-dfab3d10-0763-4607-bd38-e5318f54074f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Lock "9c42a8d5-6ffe-4953-b1e2-c735d79966d9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 02:49:04.048917 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.wsgi [None req-dfab3d10-0763-4607-bd38-e5318f54074f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] HTTP exception thrown: Instance 59870f0a-23af-4ce5-ad4b-31164db7730b could not be found. Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dfab3d10-0763-4607-bd38-e5318f54074f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Request method failure captured: Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: request: GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b HTTP/1.1 Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept: application/json Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Accept-Encoding: identity Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Connection: close Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Length: 0 Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Content-Type: application/json Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Host: 10.222.0.39 Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Openstack-System-Scope: None Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: User-Agent: python-urllib3/1.26.11 Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Auth-Token: gAAAAABi8HhhVUvtaxqpx11u078jYlk1sMRmPQIJHDx2UhBB-iLhWc1h2QZjYB08rze0WmhIAiAGaNVu53tyY6FyhMePoq7QWu2mRxz8lwy2oVhRIlE_Xa8DL_Vm4svCW5K9jDZ7szrY4XfPOYkmqLYM2pJ1uQlF1AigBVPYpPjETKnp6US5LgA Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Id: None Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Domain-Name: None Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Identity-Status: Confirmed Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Is-Admin-Project: True Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Id: default Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Domain-Name: Default Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Id: 94219d4e012248139b9df01bcdf39bbc Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Project-Name: tempest-TestShelveInstance-199090353 Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Role: reader,member Aug 08 02:49:04.050609 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Roles: reader,member Aug 08 02:49:04.053182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/94219d4e012248139b9df01bcdf39bbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/94219d4e012248139b9df01bcdf39bbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_94219d4e012248139b9df01bcdf39bbc", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/94219d4e012248139b9df01bcdf39bbc"}]}] Aug 08 02:49:04.053182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant: tempest-TestShelveInstance-199090353 Aug 08 02:49:04.053182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Id: 94219d4e012248139b9df01bcdf39bbc Aug 08 02:49:04.053182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-Tenant-Name: tempest-TestShelveInstance-199090353 Aug 08 02:49:04.053182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User: tempest-TestShelveInstance-199090353-project Aug 08 02:49:04.053182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Id: default Aug 08 02:49:04.053182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Domain-Name: Default Aug 08 02:49:04.053182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Id: 57bd48dc29f945b9873334293d85b783 Aug 08 02:49:04.053182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: X-User-Name: tempest-TestShelveInstance-199090353-project Aug 08 02:49:04.053182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: method: > Aug 08 02:49:04.053182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: exception: Instance 59870f0a-23af-4ce5-ad4b-31164db7730b could not be found. Aug 08 02:49:04.053182 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: action_args: {'id': '59870f0a-23af-4ce5-ad4b-31164db7730b'} Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: {{(pid=117640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59870f0a-23af-4ce5-ad4b-31164db7730b could not be found. Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 02:49:04.054297 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59870f0a-23af-4ce5-ad4b-31164db7730b could not be found. Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59870f0a-23af-4ce5-ad4b-31164db7730b could not be found. Aug 08 02:49:04.055994 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: ERROR nova.api.openstack.wsgi Aug 08 02:49:04.057909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: DEBUG nova.api.openstack.wsgi [None req-dfab3d10-0763-4607-bd38-e5318f54074f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Returning 404 to user: Instance 59870f0a-23af-4ce5-ad4b-31164db7730b could not be found. {{(pid=117640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 02:49:04.057909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO nova.api.openstack.requestlog [None req-dfab3d10-0763-4607-bd38-e5318f54074f tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b" status: 404 len: 111 microversion: 2.1 time: 0.030750 Aug 08 02:49:04.057909 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: [pid: 117640|app: 0|req: 661/1313] 10.222.0.39 () {58 vars in 1236 bytes} [Mon Aug 8 02:49:04 2022] GET /compute/v2.1/servers/59870f0a-23af-4ce5-ad4b-31164db7730b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 02:49:04.222380 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-68348742-4068-4da2-8e47-9b7fddc97142 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] Calling method '.version_select at 0x7f32959933a0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 02:49:04.249343 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-68348742-4068-4da2-8e47-9b7fddc97142 tempest-TestShelveInstance-199090353 tempest-TestShelveInstance-199090353-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-991636141" status: 202 len: 0 microversion: 2.1 time: 0.032221 Aug 08 02:49:04.250110 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 653/1314] 10.222.0.39 () {58 vars in 1251 bytes} [Mon Aug 8 02:49:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-991636141 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 02:50:43.540262 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:50:43.540941 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Mon Aug 8 02:50:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:52:16.015867 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:52:16.016670 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Mon Aug 8 02:52:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:52:16.949450 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:52:16.950015 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Mon Aug 8 02:52:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:52:30.058229 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:52:30.058970 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Mon Aug 8 02:52:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:54:03.548143 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:54:03.548648 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Mon Aug 8 02:54:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:54:18.830697 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:54:18.831306 dv-cinder-733062-33-iscsi devstack@n-api.service[117640]: Mon Aug 8 02:54:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 02:54:20.593408 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 02:54:20.593929 dv-cinder-733062-33-iscsi devstack@n-api.service[117642]: Mon Aug 8 02:54:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!